[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:47:15 dist-test-slave-3h5h krb5kdc[2280](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:47:15 dist-test-slave-3h5h krb5kdc[2280](info): set up 2 sockets
Aug 11 16:47:15 dist-test-slave-3h5h krb5kdc[2280](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 16:47:17.015137 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.308s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:47:17 dist-test-slave-3h5h krb5kdc[2280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:47:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:47:17.157375 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:42347
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:35535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:42347
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:17.245651 2301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:17.245929 2301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:17.245973 2301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:17.247169 2301 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:17.247244 2301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:17.247267 2301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:17.247289 2301 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:17.247320 2301 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:17.249032 2301 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:35535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:42347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:42347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:17.249512 2301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:17.249821 2301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:17.256697 2310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:17.256835 2314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:17.256857 2301 server_base.cc:1034] running on GCE node
W20260811 16:47:17.257378 2307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:17.257689 2301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:17.258067 2301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:17.259281 2301 hybrid_clock.cc:648] HybridClock initialized: now 1786466837259270 us; error 35 us; skew 500 ppm
Aug 11 16:47:17 dist-test-slave-3h5h krb5kdc[2280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466837, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:17.269456 2301 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:47:17.270270 2301 webserver.cc:460] Webserver started at http://127.2.55.190:33307/ using document root <none> and password file <none>
I20260811 16:47:17.270604 2301 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:17.270684 2301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:17.270900 2301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:17.272213 2301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "151560250cbf4b1a82bc9a5aaf07172e"
format_stamp: "Formatted at 2026-08-11 16:47:17 on dist-test-slave-3h5h"
server_key: "95b0d591979e44f19e0aa6f5b4c4c1ef"
server_key_iv: "a0633aa2d306716981cb9d0604e221ee"
server_key_version: "encryptionkey@0"
I20260811 16:47:17.272651 2301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "151560250cbf4b1a82bc9a5aaf07172e"
format_stamp: "Formatted at 2026-08-11 16:47:17 on dist-test-slave-3h5h"
server_key: "95b0d591979e44f19e0aa6f5b4c4c1ef"
server_key_iv: "a0633aa2d306716981cb9d0604e221ee"
server_key_version: "encryptionkey@0"
I20260811 16:47:17.274708 2301 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260811 16:47:17.275997 2334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:17.276393 2301 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:17.276526 2301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "151560250cbf4b1a82bc9a5aaf07172e"
format_stamp: "Formatted at 2026-08-11 16:47:17 on dist-test-slave-3h5h"
server_key: "95b0d591979e44f19e0aa6f5b4c4c1ef"
server_key_iv: "a0633aa2d306716981cb9d0604e221ee"
server_key_version: "encryptionkey@0"
I20260811 16:47:17.276629 2301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:17.290123 2301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:17.293063 2301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:17.293336 2301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:17.300770 2301 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:42347
I20260811 16:47:17.300899 2418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:42347 every 8 connection(s)
I20260811 16:47:17.301730 2301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:17.303627 2419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:17.304087 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 2301
I20260811 16:47:17.304234 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:17.305135 2270 external_mini_cluster.cc:1428] Setting key bf9affbbbdb46edbb4208cdf9eeeebc5
I20260811 16:47:17.308682 2419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e: Bootstrap starting.
I20260811 16:47:17.309899 2419 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:17.310447 2419 log.cc:824] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:17.311553 2419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e: No bootstrap required, opened a new log
I20260811 16:47:17.314770 2419 raft_consensus.cc:348] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151560250cbf4b1a82bc9a5aaf07172e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42347 } }
I20260811 16:47:17.314971 2419 raft_consensus.cc:374] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:17.315105 2419 raft_consensus.cc:729] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 151560250cbf4b1a82bc9a5aaf07172e, State: Initialized, Role: FOLLOWER
I20260811 16:47:17.315335 2419 consensus_queue.cc:260] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151560250cbf4b1a82bc9a5aaf07172e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42347 } }
I20260811 16:47:17.315471 2419 raft_consensus.cc:388] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:17.315529 2419 raft_consensus.cc:482] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:17.315593 2419 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:17.316432 2419 raft_consensus.cc:504] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151560250cbf4b1a82bc9a5aaf07172e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42347 } }
I20260811 16:47:17.316699 2419 leader_election.cc:302] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 151560250cbf4b1a82bc9a5aaf07172e; no voters:
I20260811 16:47:17.317049 2419 leader_election.cc:288] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:17.317129 2427 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:17.317389 2427 raft_consensus.cc:686] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [term 1 LEADER]: Becoming Leader. State: Replica: 151560250cbf4b1a82bc9a5aaf07172e, State: Running, Role: LEADER
I20260811 16:47:17.317595 2427 consensus_queue.cc:237] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151560250cbf4b1a82bc9a5aaf07172e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42347 } }
I20260811 16:47:17.317771 2419 sys_catalog.cc:564] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:17.318333 2428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "151560250cbf4b1a82bc9a5aaf07172e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151560250cbf4b1a82bc9a5aaf07172e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42347 } } }
I20260811 16:47:17.318337 2429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 151560250cbf4b1a82bc9a5aaf07172e. Latest consensus state: current_term: 1 leader_uuid: "151560250cbf4b1a82bc9a5aaf07172e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "151560250cbf4b1a82bc9a5aaf07172e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42347 } } }
I20260811 16:47:17.318624 2429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:17.318500 2428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:17.320194 2441 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 11 16:47:17 dist-test-slave-3h5h krb5kdc[2280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:17.321779 2441 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:17.325691 2441 catalog_manager.cc:1347] Generated new cluster ID: efa9327ed48f4b0180a342c97fe837cf
I20260811 16:47:17.325766 2441 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:47:17.326893 2425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:17.307450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55018 (local address 127.2.55.190:42347)
0811 16:47:17.307751 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:17.307764 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:17.307809 (+ 45us) server_negotiation.cc:407] Connection header received
0811 16:47:17.310415 (+ 2606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:17.310426 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:17.310572 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:17.310770 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:17.312681 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:17.314476 (+ 1795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:17.315974 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:17.316729 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:17.316922 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:17.322146 (+ 5224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:17.322151 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:17.322151 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:17.322174 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:17.324240 (+ 2066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:17.324927 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:17.324930 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:17.324931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:17.325076 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:17.325416 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:17.325418 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:17.325418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:17.325796 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:17.325986 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:17.326398 (+ 412us) server_negotiation.cc:299] Negotiation successful
0811 16:47:17.326599 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":93,"threads_started":1}
I20260811 16:47:17.343461 2441 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:17.344254 2441 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:17.354674 2441 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 151560250cbf4b1a82bc9a5aaf07172e: Generated new TSK 0
I20260811 16:47:17.354933 2441 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:47:17.392428 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42347
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:35535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:17.510599 2459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:17.510856 2459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:17.510906 2459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:17.512313 2459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:17.512391 2459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:17.512444 2459 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:47:17.514361 2459 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:35535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42347
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:17.514782 2459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:17.515059 2459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:17.521237 2471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:17.521384 2467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:17.521431 2465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:17.522115 2459 server_base.cc:1034] running on GCE node
I20260811 16:47:17.522351 2459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:17.522614 2459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:17.523801 2459 hybrid_clock.cc:648] HybridClock initialized: now 1786466837523777 us; error 40 us; skew 500 ppm
Aug 11 16:47:17 dist-test-slave-3h5h krb5kdc[2280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466837, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:17.526779 2459 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:47:17.527302 2459 webserver.cc:460] Webserver started at http://127.2.55.129:33395/ using document root <none> and password file <none>
I20260811 16:47:17.527554 2459 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:17.527627 2459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:17.527791 2459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:17.529052 2459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "5a292c6ed66a4a3b9f1b86f58c99faef"
format_stamp: "Formatted at 2026-08-11 16:47:17 on dist-test-slave-3h5h"
server_key: "0ddb958f3c0d2ef2a55e70b86df6127d"
server_key_iv: "d33c80251864240a333274264c4e4b37"
server_key_version: "encryptionkey@0"
I20260811 16:47:17.529492 2459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "5a292c6ed66a4a3b9f1b86f58c99faef"
format_stamp: "Formatted at 2026-08-11 16:47:17 on dist-test-slave-3h5h"
server_key: "0ddb958f3c0d2ef2a55e70b86df6127d"
server_key_iv: "d33c80251864240a333274264c4e4b37"
server_key_version: "encryptionkey@0"
I20260811 16:47:17.531065 2459 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:47:17.531889 2481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:17.532156 2459 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:17.532272 2459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "5a292c6ed66a4a3b9f1b86f58c99faef"
format_stamp: "Formatted at 2026-08-11 16:47:17 on dist-test-slave-3h5h"
server_key: "0ddb958f3c0d2ef2a55e70b86df6127d"
server_key_iv: "d33c80251864240a333274264c4e4b37"
server_key_version: "encryptionkey@0"
I20260811 16:47:17.532346 2459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:17.563102 2459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:17.565569 2459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:17.565691 2459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:17.565977 2459 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:17.566356 2459 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:17.566431 2459 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:17.566457 2459 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:17.566469 2459 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:17.575323 2459 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:43817
I20260811 16:47:17.575392 2683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:43817 every 8 connection(s)
I20260811 16:47:17.575742 2459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:47:17.580509 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 2459
I20260811 16:47:17.580610 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:47:17.580806 2270 external_mini_cluster.cc:1428] Setting key 27f1bfa5162704d88f745a9247dc3857
Aug 11 16:47:17 dist-test-slave-3h5h krb5kdc[2280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466837, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:17.587069 2425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:17.576877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:54445 (local address 127.2.55.190:42347)
0811 16:47:17.576953 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:17.576956 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:17.577176 (+ 220us) server_negotiation.cc:407] Connection header received
0811 16:47:17.577775 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:17.577776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:17.577790 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:17.577843 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:17.579026 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:17.579622 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:17.580768 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:17.581113 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:17.581203 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:17.583704 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:17.583706 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:17.583706 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:17.583716 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:17.585454 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:17.585885 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:17.585886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:17.585887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:17.585957 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:17.586242 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:17.586243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:17.586243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:17.586421 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:17.586505 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:17.586829 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 16:47:17.586952 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 16:47:17.587164 2687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:17.576770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:42347 (local address 127.2.55.129:54445)
0811 16:47:17.577048 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:17.577089 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:17.577620 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:17.577921 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:17.577924 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:17.578709 (+ 785us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:17.578909 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:17.578914 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:17.579722 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:17.579724 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:17.580570 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:17.580599 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:17.581224 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:17.581225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:17.581382 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:17.582095 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:17.582104 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:17.583562 (+ 1458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:17.585546 (+ 1984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:17.585554 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:17.585556 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:17.585803 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:17.586039 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:17.586039 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:17.586040 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:17.586160 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:17.586533 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:17.586541 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:17.586672 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 16:47:17.586775 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 16:47:17.586920 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":155,"threads_started":1}
I20260811 16:47:17.587848 2685 heartbeater.cc:347] Connected to a master server at 127.2.55.190:42347
I20260811 16:47:17.588024 2685 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:17.588250 2685 heartbeater.cc:511] Master 127.2.55.190:42347 requested a full tablet report, sending...
I20260811 16:47:17.589408 2355 ts_manager.cc:194] Registered new tserver with Master: 5a292c6ed66a4a3b9f1b86f58c99faef (127.2.55.129:43817)
I20260811 16:47:17.590546 2355 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:54445
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:47:17.612560 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42347
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:35535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:17.710317 2692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:17.710515 2692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:17.710538 2692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:17.711604 2692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:17.711638 2692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:17.711664 2692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:47:17.713263 2692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:35535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42347
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:17.713460 2692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:17.713639 2692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:17.719108 2699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:17.719180 2704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:17.719156 2700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:17.719367 2692 server_base.cc:1034] running on GCE node
I20260811 16:47:17.719584 2692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:17.719853 2692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:17.721086 2692 hybrid_clock.cc:648] HybridClock initialized: now 1786466837721071 us; error 30 us; skew 500 ppm
Aug 11 16:47:17 dist-test-slave-3h5h krb5kdc[2280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466837, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:17.723718 2692 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:47:17.724161 2692 webserver.cc:460] Webserver started at http://127.2.55.130:34913/ using document root <none> and password file <none>
I20260811 16:47:17.724368 2692 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:17.724409 2692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:17.724500 2692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:17.725612 2692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "16f6e6e95b30453585fc74098857f8a5"
format_stamp: "Formatted at 2026-08-11 16:47:17 on dist-test-slave-3h5h"
server_key: "fcaa46fdf3c00e0b2d64fb18ea6e5c10"
server_key_iv: "61475d3587681343350bb27aa01f73b8"
server_key_version: "encryptionkey@0"
I20260811 16:47:17.725936 2692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "16f6e6e95b30453585fc74098857f8a5"
format_stamp: "Formatted at 2026-08-11 16:47:17 on dist-test-slave-3h5h"
server_key: "fcaa46fdf3c00e0b2d64fb18ea6e5c10"
server_key_iv: "61475d3587681343350bb27aa01f73b8"
server_key_version: "encryptionkey@0"
I20260811 16:47:17.727305 2692 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:47:17.728017 2718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:17.728211 2692 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:47:17.728319 2692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "16f6e6e95b30453585fc74098857f8a5"
format_stamp: "Formatted at 2026-08-11 16:47:17 on dist-test-slave-3h5h"
server_key: "fcaa46fdf3c00e0b2d64fb18ea6e5c10"
server_key_iv: "61475d3587681343350bb27aa01f73b8"
server_key_version: "encryptionkey@0"
I20260811 16:47:17.728394 2692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:17.762701 2692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:17.765311 2692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:17.765482 2692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:17.765782 2692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:17.766189 2692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:17.766249 2692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:17.766292 2692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:17.766322 2692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:17.774796 2692 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:37085
I20260811 16:47:17.774844 2901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:37085 every 8 connection(s)
I20260811 16:47:17.775231 2692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:47:17.779800 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 2692
I20260811 16:47:17.779898 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:47:17.780071 2270 external_mini_cluster.cc:1428] Setting key d6806cd7d9ea2421074ed132c044763a
Aug 11 16:47:17 dist-test-slave-3h5h krb5kdc[2280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466837, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:17.787006 2425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:17.776169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:45785 (local address 127.2.55.190:42347)
0811 16:47:17.776261 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:17.776264 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:17.776477 (+ 213us) server_negotiation.cc:407] Connection header received
0811 16:47:17.777293 (+ 816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:17.777294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:17.777308 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:17.777365 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:17.778392 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:17.778933 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:17.780169 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:17.780478 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:17.780538 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:17.783637 (+ 3099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:17.783640 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:17.783640 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:17.783648 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:17.785132 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:17.785687 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:17.785688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:17.785688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:17.785745 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:17.786101 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:17.786103 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:17.786103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:17.786253 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:17.786321 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:17.786708 (+ 387us) server_negotiation.cc:299] Negotiation successful
0811 16:47:17.786873 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:47:17.787086 2906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:17.776080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:42347 (local address 127.2.55.130:45785)
0811 16:47:17.776321 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:17.776380 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:17.777170 (+ 790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:17.777438 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:17.777442 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:17.778074 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:17.778285 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:17.778291 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:17.779044 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:17.779045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:17.780068 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:17.780072 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:17.780564 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:17.780565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:17.780719 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:17.781521 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:17.781532 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:17.783509 (+ 1977us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:17.785218 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:17.785226 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:17.785228 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:17.785585 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:17.785816 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:17.785817 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:17.785818 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:17.785974 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:17.786340 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:17.786349 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:17.786537 (+ 188us) client_negotiation.cc:769] Sending connection context
0811 16:47:17.786668 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 16:47:17.786837 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":111,"threads_started":1}
I20260811 16:47:17.787640 2902 heartbeater.cc:347] Connected to a master server at 127.2.55.190:42347
I20260811 16:47:17.787734 2902 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:17.787933 2902 heartbeater.cc:511] Master 127.2.55.190:42347 requested a full tablet report, sending...
I20260811 16:47:17.788379 2355 ts_manager.cc:194] Registered new tserver with Master: 16f6e6e95b30453585fc74098857f8a5 (127.2.55.130:37085)
I20260811 16:47:17.788991 2355 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:45785
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:47:17.812201 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42347
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:35535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:17.906075 2912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:17.906281 2912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:17.906339 2912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:17.907519 2912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:17.907563 2912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:17.907590 2912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:47:17.909104 2912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:35535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42347
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:17.909291 2912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:17.909467 2912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:17.914839 2922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:17.914868 2919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:17.915087 2912 server_base.cc:1034] running on GCE node
W20260811 16:47:17.914873 2920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:17.915589 2912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:17.915876 2912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:17.917045 2912 hybrid_clock.cc:648] HybridClock initialized: now 1786466837917015 us; error 56 us; skew 500 ppm
Aug 11 16:47:17 dist-test-slave-3h5h krb5kdc[2280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466837, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:17.920248 2912 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:47:17.920650 2912 webserver.cc:460] Webserver started at http://127.2.55.131:46381/ using document root <none> and password file <none>
I20260811 16:47:17.920886 2912 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:17.920955 2912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:17.921064 2912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:17.922115 2912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "d1c1bf7d29a248fc85e288cc013fd70d"
format_stamp: "Formatted at 2026-08-11 16:47:17 on dist-test-slave-3h5h"
server_key: "3c1883bf7a2a40d225fb6f1f50a624d4"
server_key_iv: "e9677880f3b60b4c489f126358df64c6"
server_key_version: "encryptionkey@0"
I20260811 16:47:17.922453 2912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "d1c1bf7d29a248fc85e288cc013fd70d"
format_stamp: "Formatted at 2026-08-11 16:47:17 on dist-test-slave-3h5h"
server_key: "3c1883bf7a2a40d225fb6f1f50a624d4"
server_key_iv: "e9677880f3b60b4c489f126358df64c6"
server_key_version: "encryptionkey@0"
I20260811 16:47:17.923779 2912 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:17.924564 2933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:17.924752 2912 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:17.924827 2912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "d1c1bf7d29a248fc85e288cc013fd70d"
format_stamp: "Formatted at 2026-08-11 16:47:17 on dist-test-slave-3h5h"
server_key: "3c1883bf7a2a40d225fb6f1f50a624d4"
server_key_iv: "e9677880f3b60b4c489f126358df64c6"
server_key_version: "encryptionkey@0"
I20260811 16:47:17.924940 2912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:17.937752 2912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:17.940065 2912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:17.940183 2912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:17.940366 2912 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:17.940625 2912 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:17.940655 2912 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:17.940677 2912 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:17.940690 2912 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:17.948487 2912 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:44211
I20260811 16:47:17.948575 3129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:44211 every 8 connection(s)
I20260811 16:47:17.949041 2912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:47:17.950287 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 2912
I20260811 16:47:17.950373 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:47:17.950536 2270 external_mini_cluster.cc:1428] Setting key 1632a99550006af80fd145357a8c0efe
Aug 11 16:47:17 dist-test-slave-3h5h krb5kdc[2280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466837, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:17.959748 2425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:17.949871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:49063 (local address 127.2.55.190:42347)
0811 16:47:17.949983 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:17.949985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:17.950333 (+ 348us) server_negotiation.cc:407] Connection header received
0811 16:47:17.951018 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:17.951019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:17.951096 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:17.951178 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:17.952445 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:17.953035 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:17.954191 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:17.954405 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:17.954493 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:17.956685 (+ 2192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:17.956687 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:17.956687 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:17.956694 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:17.958366 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:17.958773 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:17.958774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:17.958774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:17.958827 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:17.959106 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:17.959107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:17.959107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:17.959220 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:17.959281 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:17.959610 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 16:47:17.959678 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 16:47:17.959889 3134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:17.949817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:42347 (local address 127.2.55.131:49063)
0811 16:47:17.950164 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:17.950217 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:17.950926 (+ 709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:17.951271 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:17.951275 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:17.952143 (+ 868us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:17.952348 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:17.952353 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:17.953129 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:17.953130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:17.954080 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:17.954083 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:17.954503 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:17.954504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:17.954636 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:17.955119 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:17.955128 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:17.956594 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:17.958452 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:17.958459 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:17.958461 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:17.958703 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:17.958885 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:17.958886 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:17.958886 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:17.958996 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:17.959311 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:17.959317 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:17.959442 (+ 125us) client_negotiation.cc:769] Sending connection context
0811 16:47:17.959546 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 16:47:17.959678 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":167,"threads_started":1}
I20260811 16:47:17.960567 3130 heartbeater.cc:347] Connected to a master server at 127.2.55.190:42347
I20260811 16:47:17.960690 3130 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:17.960942 3130 heartbeater.cc:511] Master 127.2.55.190:42347 requested a full tablet report, sending...
I20260811 16:47:17.961472 2355 ts_manager.cc:194] Registered new tserver with Master: d1c1bf7d29a248fc85e288cc013fd70d (127.2.55.131:44211)
I20260811 16:47:17.961881 2355 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:49063
I20260811 16:47:17.962900 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 16:47:17 dist-test-slave-3h5h krb5kdc[2280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466837, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 16:47:17 dist-test-slave-3h5h krb5kdc[2280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466837, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.2.55.129@KRBTEST.COM
I20260811 16:47:17.990471 3140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:17.981788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45024 (local address 127.2.55.129:43817)
0811 16:47:17.982025 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:17.982031 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:17.982043 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:47:17.982072 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:17.982075 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:17.982094 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:17.982176 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:17.982836 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:17.983634 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:17.984405 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:17.984754 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:17.984815 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:17.987514 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:17.987523 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:17.987523 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:17.987531 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:17.989138 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:17.989478 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:17.989481 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:17.989481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:17.989541 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:17.989771 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:17.989771 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:17.989771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:17.989928 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:17.990055 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:17.990245 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 16:47:17.990314 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":107,"threads_started":1}
W20260811 16:47:17.991062 2522 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45024
Aug 11 16:47:18 dist-test-slave-3h5h krb5kdc[2280](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 16:47:18 dist-test-slave-3h5h krb5kdc[2280](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.129@KRBTEST.COM
I20260811 16:47:18.018776 3140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:18.009860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45034 (local address 127.2.55.129:43817)
0811 16:47:18.009952 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:18.009955 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:18.010146 (+ 191us) server_negotiation.cc:407] Connection header received
0811 16:47:18.010274 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:18.010275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:18.010289 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:18.010368 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:18.011072 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:18.011648 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:18.012494 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:18.012734 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:18.012870 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:18.015529 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:18.015531 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:18.015532 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:18.015540 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:18.017213 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:18.017714 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:18.017715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:18.017716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:18.017814 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:18.018255 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:18.018255 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:18.018256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:18.018366 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:18.018464 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:18.018624 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 16:47:18.018701 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 16:47:18.019529 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 2459
I20260811 16:47:18.034437 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 2692
I20260811 16:47:18.046670 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 2912
I20260811 16:47:18.059296 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 2301
2026-08-11T16:47:18Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2384 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:47:18 dist-test-slave-3h5h krb5kdc[3150](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:47:18 dist-test-slave-3h5h krb5kdc[3150](info): set up 2 sockets
Aug 11 16:47:18 dist-test-slave-3h5h krb5kdc[3150](info): commencing operation
krb5kdc: starting...
W20260811 16:47:19.349664 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:47:19 dist-test-slave-3h5h krb5kdc[3150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466839, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:47:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:47:19.488265 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:40223
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:40223
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:19.574707 3172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:19.574983 3172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:19.575038 3172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:19.576313 3172 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:19.576391 3172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:19.576416 3172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:19.576447 3172 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:19.576496 3172 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:19.578169 3172 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:40223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:40223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:19.578481 3172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:19.578714 3172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:19.584228 3181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:19.584236 3182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:19.584250 3184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:19.584597 3172 server_base.cc:1034] running on GCE node
I20260811 16:47:19.584970 3172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:19.585336 3172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:19.586557 3172 hybrid_clock.cc:648] HybridClock initialized: now 1786466839586547 us; error 60 us; skew 500 ppm
Aug 11 16:47:19 dist-test-slave-3h5h krb5kdc[3150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466839, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:19.589718 3172 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:47:19.590306 3172 webserver.cc:460] Webserver started at http://127.2.55.190:43359/ using document root <none> and password file <none>
I20260811 16:47:19.590581 3172 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:19.590658 3172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:19.590812 3172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:19.591912 3172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "bdcc19a9208c429f8d47329f0e3b98a7"
format_stamp: "Formatted at 2026-08-11 16:47:19 on dist-test-slave-3h5h"
server_key: "4aa29291b40891dd0d0e114a0ed58517"
server_key_iv: "0adfe9071ae80fa3dc64225188062724"
server_key_version: "encryptionkey@0"
I20260811 16:47:19.592306 3172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "bdcc19a9208c429f8d47329f0e3b98a7"
format_stamp: "Formatted at 2026-08-11 16:47:19 on dist-test-slave-3h5h"
server_key: "4aa29291b40891dd0d0e114a0ed58517"
server_key_iv: "0adfe9071ae80fa3dc64225188062724"
server_key_version: "encryptionkey@0"
I20260811 16:47:19.593883 3172 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:19.594974 3196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:19.595301 3172 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:19.595438 3172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "bdcc19a9208c429f8d47329f0e3b98a7"
format_stamp: "Formatted at 2026-08-11 16:47:19 on dist-test-slave-3h5h"
server_key: "4aa29291b40891dd0d0e114a0ed58517"
server_key_iv: "0adfe9071ae80fa3dc64225188062724"
server_key_version: "encryptionkey@0"
I20260811 16:47:19.595518 3172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:19.605209 3172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:19.607474 3172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:19.607662 3172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:19.611935 3172 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:40223
I20260811 16:47:19.611989 3275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:40223 every 8 connection(s)
I20260811 16:47:19.612416 3172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:19.613528 3276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:19.614269 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 3172
I20260811 16:47:19.614341 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:19.614511 2270 external_mini_cluster.cc:1428] Setting key 6088b8bb9e22bbf727243b6024ffaf3d
I20260811 16:47:19.616560 3276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7: Bootstrap starting.
I20260811 16:47:19.617225 3276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:19.617542 3276 log.cc:824] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:19.618338 3276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7: No bootstrap required, opened a new log
I20260811 16:47:19.620988 3276 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcc19a9208c429f8d47329f0e3b98a7" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40223 } }
I20260811 16:47:19.621129 3276 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:19.621152 3276 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdcc19a9208c429f8d47329f0e3b98a7, State: Initialized, Role: FOLLOWER
I20260811 16:47:19.621291 3276 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcc19a9208c429f8d47329f0e3b98a7" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40223 } }
I20260811 16:47:19.621367 3276 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:19.621390 3276 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:19.621459 3276 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 16:47:19 dist-test-slave-3h5h krb5kdc[3150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466839, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:19.622123 3276 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcc19a9208c429f8d47329f0e3b98a7" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40223 } }
I20260811 16:47:19.622211 3276 leader_election.cc:302] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdcc19a9208c429f8d47329f0e3b98a7; no voters:
I20260811 16:47:19.622433 3276 leader_election.cc:288] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:19.622459 3283 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:19.622587 3283 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [term 1 LEADER]: Becoming Leader. State: Replica: bdcc19a9208c429f8d47329f0e3b98a7, State: Running, Role: LEADER
I20260811 16:47:19.622678 3283 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcc19a9208c429f8d47329f0e3b98a7" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40223 } }
I20260811 16:47:19.622716 3276 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:19.622980 3283 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdcc19a9208c429f8d47329f0e3b98a7. Latest consensus state: current_term: 1 leader_uuid: "bdcc19a9208c429f8d47329f0e3b98a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcc19a9208c429f8d47329f0e3b98a7" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40223 } } }
I20260811 16:47:19.623040 3283 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:19.622998 3285 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdcc19a9208c429f8d47329f0e3b98a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdcc19a9208c429f8d47329f0e3b98a7" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40223 } } }
I20260811 16:47:19.623354 3285 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7 [sys.catalog]: This master's current role is: LEADER
W20260811 16:47:19.624739 3309 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:47:19.624799 3309 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:47:19.624945 3289 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:19.625198 3289 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:19.626353 3279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:19.615093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39472 (local address 127.2.55.190:40223)
0811 16:47:19.615287 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:19.615295 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:19.615320 (+ 25us) server_negotiation.cc:407] Connection header received
0811 16:47:19.615731 (+ 411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:19.615737 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:19.615781 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:19.615930 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:19.616567 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:19.617612 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:19.618678 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:19.619124 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:19.619217 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:19.622112 (+ 2895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:19.622116 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:19.622116 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:19.622127 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:19.624458 (+ 2331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:19.624983 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:19.624986 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:19.624987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:19.625099 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:19.625358 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:19.625359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:19.625360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:19.625675 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:19.625811 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:19.626103 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 16:47:19.626212 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":83,"threads_started":1}
I20260811 16:47:19.629905 3289 catalog_manager.cc:1347] Generated new cluster ID: b0cb25e08c774b4ab53b73aa42d00642
I20260811 16:47:19.629963 3289 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:47:19.640563 3289 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:19.641278 3289 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:19.647296 3289 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdcc19a9208c429f8d47329f0e3b98a7: Generated new TSK 0
I20260811 16:47:19.647500 3289 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:47:19.681989 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40223
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:19.766988 3318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:19.767280 3318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:19.767305 3318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:19.768467 3318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:19.768512 3318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:19.768538 3318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:47:19.770130 3318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40223
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:19.770380 3318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:19.770627 3318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:19.776299 3328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:19.776361 3327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:19.776278 3331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:19.776525 3318 server_base.cc:1034] running on GCE node
I20260811 16:47:19.776909 3318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:19.777163 3318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:19.778404 3318 hybrid_clock.cc:648] HybridClock initialized: now 1786466839778393 us; error 40 us; skew 500 ppm
Aug 11 16:47:19 dist-test-slave-3h5h krb5kdc[3150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466839, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:19.781389 3318 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:47:19.781919 3318 webserver.cc:460] Webserver started at http://127.2.55.129:39863/ using document root <none> and password file <none>
I20260811 16:47:19.782197 3318 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:19.782251 3318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:19.782395 3318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:19.783610 3318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "a666e9dace3d4596975591238b6d0017"
format_stamp: "Formatted at 2026-08-11 16:47:19 on dist-test-slave-3h5h"
server_key: "be2026b0aa585654c2514268d3fcc435"
server_key_iv: "c3e5ae2491468077c25e6dbde14b9f06"
server_key_version: "encryptionkey@0"
I20260811 16:47:19.784018 3318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "a666e9dace3d4596975591238b6d0017"
format_stamp: "Formatted at 2026-08-11 16:47:19 on dist-test-slave-3h5h"
server_key: "be2026b0aa585654c2514268d3fcc435"
server_key_iv: "c3e5ae2491468077c25e6dbde14b9f06"
server_key_version: "encryptionkey@0"
I20260811 16:47:19.785651 3318 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:19.786615 3342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:19.786810 3318 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:19.786928 3318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "a666e9dace3d4596975591238b6d0017"
format_stamp: "Formatted at 2026-08-11 16:47:19 on dist-test-slave-3h5h"
server_key: "be2026b0aa585654c2514268d3fcc435"
server_key_iv: "c3e5ae2491468077c25e6dbde14b9f06"
server_key_version: "encryptionkey@0"
I20260811 16:47:19.787109 3318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:19.805226 3318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:19.807701 3318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:19.807875 3318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:19.808195 3318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:19.808552 3318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:19.808619 3318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:19.808662 3318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:19.808693 3318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:19.815023 3318 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:45507
I20260811 16:47:19.815202 3526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:45507 every 8 connection(s)
I20260811 16:47:19.815471 3318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:47:19.817982 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 3318
I20260811 16:47:19.818089 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:47:19.818249 2270 external_mini_cluster.cc:1428] Setting key 940a0c9a80727c7ee87b6842f9d6ee1f
Aug 11 16:47:19 dist-test-slave-3h5h krb5kdc[3150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466839, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:19.827791 3279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:19.816468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:41513 (local address 127.2.55.190:40223)
0811 16:47:19.816544 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:19.816547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:19.816767 (+ 220us) server_negotiation.cc:407] Connection header received
0811 16:47:19.817862 (+ 1095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:19.817864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:19.817876 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:19.817938 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:19.818814 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:19.819412 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:19.821005 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:19.821342 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:19.821425 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:19.824290 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:19.824291 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:19.824292 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:19.824301 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:19.826173 (+ 1872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:19.826655 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:19.826657 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:19.826658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:19.826729 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:19.827010 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:19.827012 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:19.827013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:19.827172 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:19.827252 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:19.827569 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 16:47:19.827668 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 16:47:19.827837 3533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:19.816428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:40223 (local address 127.2.55.129:41513)
0811 16:47:19.816623 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:19.816663 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:19.817718 (+ 1055us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:19.818028 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:19.818033 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:19.818425 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:19.818719 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:19.818724 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:19.819520 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:19.819521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:19.820903 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:19.820906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:19.821436 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:19.821437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:19.821545 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:19.822152 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:19.822161 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:19.824181 (+ 2020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:19.826278 (+ 2097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:19.826286 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:19.826288 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:19.826566 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:19.826808 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:19.826808 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:19.826809 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:19.826932 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:19.827248 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:19.827254 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:19.827393 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 16:47:19.827512 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 16:47:19.827648 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":124,"threads_started":1}
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
I20260811 16:47:19.828548 3527 heartbeater.cc:347] Connected to a master server at 127.2.55.190:40223
I20260811 16:47:19.828682 3527 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:19.828951 3527 heartbeater.cc:511] Master 127.2.55.190:40223 requested a full tablet report, sending...
I20260811 16:47:19.829700 3223 ts_manager.cc:194] Registered new tserver with Master: a666e9dace3d4596975591238b6d0017 (127.2.55.129:45507)
I20260811 16:47:19.830456 3223 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:41513
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:47:19.848232 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40223
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:19.936172 3537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:19.936403 3537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:19.936430 3537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:19.937932 3537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:19.937990 3537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:19.938022 3537 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:47:19.939762 3537 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40223
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3537
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:19.940053 3537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:19.940341 3537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:19.946364 3549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:19.946416 3546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:19.946607 3537 server_base.cc:1034] running on GCE node
W20260811 16:47:19.946676 3544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:19.946949 3537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:19.947232 3537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:19.948405 3537 hybrid_clock.cc:648] HybridClock initialized: now 1786466839948396 us; error 58 us; skew 500 ppm
Aug 11 16:47:19 dist-test-slave-3h5h krb5kdc[3150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466839, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:19.951195 3537 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:47:19.951715 3537 webserver.cc:460] Webserver started at http://127.2.55.130:45957/ using document root <none> and password file <none>
I20260811 16:47:19.951985 3537 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:19.952064 3537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:19.952219 3537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:19.953399 3537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "250841de0727494696e7d10b1388eb43"
format_stamp: "Formatted at 2026-08-11 16:47:19 on dist-test-slave-3h5h"
server_key: "1e9560ed1a1a8e289443fde25ed9d3bc"
server_key_iv: "4ab00c7241064ca5d589ddf2e52076d3"
server_key_version: "encryptionkey@0"
I20260811 16:47:19.953778 3537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "250841de0727494696e7d10b1388eb43"
format_stamp: "Formatted at 2026-08-11 16:47:19 on dist-test-slave-3h5h"
server_key: "1e9560ed1a1a8e289443fde25ed9d3bc"
server_key_iv: "4ab00c7241064ca5d589ddf2e52076d3"
server_key_version: "encryptionkey@0"
I20260811 16:47:19.955159 3537 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:47:19.955971 3562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:19.956257 3537 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:19.956372 3537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "250841de0727494696e7d10b1388eb43"
format_stamp: "Formatted at 2026-08-11 16:47:19 on dist-test-slave-3h5h"
server_key: "1e9560ed1a1a8e289443fde25ed9d3bc"
server_key_iv: "4ab00c7241064ca5d589ddf2e52076d3"
server_key_version: "encryptionkey@0"
I20260811 16:47:19.956449 3537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:19.993963 3537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:19.996652 3537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:19.996974 3537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:19.997283 3537 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:19.997762 3537 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:19.997813 3537 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:19.997850 3537 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:19.997880 3537 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:20.004093 3537 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:41639
I20260811 16:47:20.004159 3749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:41639 every 8 connection(s)
I20260811 16:47:20.004498 3537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:47:20.004942 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 3537
I20260811 16:47:20.005134 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:47:20.005306 2270 external_mini_cluster.cc:1428] Setting key 34bf4ac73030a402be69d7c874f3f996
Aug 11 16:47:20 dist-test-slave-3h5h krb5kdc[3150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466839, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
I20260811 16:47:20.017431 3279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.005436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:38107 (local address 127.2.55.190:40223)
0811 16:47:20.005497 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:20.005507 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:20.005759 (+ 252us) server_negotiation.cc:407] Connection header received
0811 16:47:20.007096 (+ 1337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:20.007097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:20.007108 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:20.007162 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:20.008132 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.008982 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.010743 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.010930 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.010993 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.013941 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:20.013943 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:20.013944 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:20.013953 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:20.015639 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:20.016210 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:20.016211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:20.016212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:20.016282 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:20.016586 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:20.016587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:20.016588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:20.016724 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:20.016810 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:20.017270 (+ 460us) server_negotiation.cc:299] Negotiation successful
0811 16:47:20.017353 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:47:20.017671 3752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.005390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:40223 (local address 127.2.55.130:38107)
0811 16:47:20.005594 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:20.005647 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:20.006964 (+ 1317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:20.007240 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:20.007244 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:20.007717 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:20.008009 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:20.008018 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.009088 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.009094 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:20.010643 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:20.010647 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.011050 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.011052 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:20.011224 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.011797 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:20.011809 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:20.013823 (+ 2014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:20.015755 (+ 1932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:20.015764 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:20.015767 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:20.016112 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:20.016361 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:20.016362 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:20.016363 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:20.016495 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:20.016800 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:20.016808 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:20.017052 (+ 244us) client_negotiation.cc:769] Sending connection context
0811 16:47:20.017221 (+ 169us) client_negotiation.cc:240] Negotiation successful
0811 16:47:20.017392 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":114,"threads_started":1}
I20260811 16:47:20.018496 3750 heartbeater.cc:347] Connected to a master server at 127.2.55.190:40223
I20260811 16:47:20.018621 3750 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:20.018784 3750 heartbeater.cc:511] Master 127.2.55.190:40223 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
I20260811 16:47:20.019368 3223 ts_manager.cc:194] Registered new tserver with Master: 250841de0727494696e7d10b1388eb43 (127.2.55.130:41639)
I20260811 16:47:20.019918 3223 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:38107
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:47:20.039920 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40223
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:20.127342 3758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:20.127568 3758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:20.127596 3758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:20.128959 3758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:20.129020 3758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:20.129078 3758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:47:20.130789 3758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40223
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:20.131084 3758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:20.131373 3758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:47:20.137274 3758 server_base.cc:1034] running on GCE node
W20260811 16:47:20.137243 3764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:20.137243 3768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:20.137266 3765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:20.137775 3758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:20.137995 3758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:20.139158 3758 hybrid_clock.cc:648] HybridClock initialized: now 1786466840139136 us; error 46 us; skew 500 ppm
Aug 11 16:47:20 dist-test-slave-3h5h krb5kdc[3150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466840, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:20.141971 3758 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:47:20.142592 3758 webserver.cc:460] Webserver started at http://127.2.55.131:44065/ using document root <none> and password file <none>
I20260811 16:47:20.142865 3758 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:20.142942 3758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:20.143115 3758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:20.144299 3758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "249558e04f2f4d5395e33b7d680abe5f"
format_stamp: "Formatted at 2026-08-11 16:47:20 on dist-test-slave-3h5h"
server_key: "07567d7fcfde2f0469ce0918b5ea5988"
server_key_iv: "216cbc158bad61dcf1a3b18afebdda80"
server_key_version: "encryptionkey@0"
I20260811 16:47:20.144788 3758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "249558e04f2f4d5395e33b7d680abe5f"
format_stamp: "Formatted at 2026-08-11 16:47:20 on dist-test-slave-3h5h"
server_key: "07567d7fcfde2f0469ce0918b5ea5988"
server_key_iv: "216cbc158bad61dcf1a3b18afebdda80"
server_key_version: "encryptionkey@0"
I20260811 16:47:20.146576 3758 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260811 16:47:20.147558 3779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:20.147755 3758 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:20.147876 3758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "249558e04f2f4d5395e33b7d680abe5f"
format_stamp: "Formatted at 2026-08-11 16:47:20 on dist-test-slave-3h5h"
server_key: "07567d7fcfde2f0469ce0918b5ea5988"
server_key_iv: "216cbc158bad61dcf1a3b18afebdda80"
server_key_version: "encryptionkey@0"
I20260811 16:47:20.147957 3758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:20.161906 3758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:20.164433 3758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:20.164621 3758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:20.164935 3758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:20.165302 3758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:20.165338 3758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:20.165395 3758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:20.165422 3758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:20.171780 3758 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:46743
I20260811 16:47:20.171849 3957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:46743 every 8 connection(s)
I20260811 16:47:20.172288 3758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:47:20.176075 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 3758
I20260811 16:47:20.176213 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:47:20.176400 2270 external_mini_cluster.cc:1428] Setting key 2d7c5755e5f4052e43e423329fc073a2
Aug 11 16:47:20 dist-test-slave-3h5h krb5kdc[3150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466840, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:20.183446 3279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.173386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:58193 (local address 127.2.55.190:40223)
0811 16:47:20.173474 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:20.173477 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:20.173616 (+ 139us) server_negotiation.cc:407] Connection header received
0811 16:47:20.174713 (+ 1097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:20.174715 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:20.174727 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:20.174791 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:20.175612 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.176110 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.177731 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.177943 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.178032 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.180440 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:20.180442 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:20.180463 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:20.180471 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:20.181770 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:20.182213 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:20.182215 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:20.182215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:20.182280 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:20.182551 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:20.182552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:20.182553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:20.182676 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:20.182780 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:20.183250 (+ 470us) server_negotiation.cc:299] Negotiation successful
0811 16:47:20.183346 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 16:47:20.183676 3961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.173231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:40223 (local address 127.2.55.131:58193)
0811 16:47:20.173455 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:20.173509 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:20.174578 (+ 1069us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:20.174903 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:20.174907 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:20.175272 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:20.175520 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:20.175526 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.176280 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.176281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:20.177606 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:20.177629 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.178043 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.178044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:20.178196 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.178754 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:20.178763 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:20.180334 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:20.181869 (+ 1535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:20.181877 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:20.181879 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:20.182110 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:20.182357 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:20.182358 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:20.182358 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:20.182477 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:20.182770 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:20.182778 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:20.183030 (+ 252us) client_negotiation.cc:769] Sending connection context
0811 16:47:20.183217 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 16:47:20.183418 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":83,"threads_started":1}
I20260811 16:47:20.184257 3958 heartbeater.cc:347] Connected to a master server at 127.2.55.190:40223
I20260811 16:47:20.184370 3958 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:20.184572 3958 heartbeater.cc:511] Master 127.2.55.190:40223 requested a full tablet report, sending...
I20260811 16:47:20.185021 3223 ts_manager.cc:194] Registered new tserver with Master: 249558e04f2f4d5395e33b7d680abe5f (127.2.55.131:46743)
I20260811 16:47:20.185417 3223 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:58193
I20260811 16:47:20.188318 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:47:20.197255 3279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.190568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39484 (local address 127.2.55.190:40223)
0811 16:47:20.190618 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:20.190620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:20.190740 (+ 120us) server_negotiation.cc:407] Connection header received
0811 16:47:20.190781 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:20.190782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:20.190793 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:20.190841 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:20.191543 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.192094 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.192914 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.193208 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.193289 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.194567 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:20.194569 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:20.194569 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:20.194578 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:20.196060 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:20.196418 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:20.196418 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:20.196419 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:20.196472 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:20.196649 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:20.196650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:20.196650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:20.196788 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:20.196932 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:20.197090 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 16:47:20.197157 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:47:20.200767 3223 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39484:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:47:20.203011 3223 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:20.211309 3977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.206793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46034 (local address 127.2.55.129:45507)
0811 16:47:20.207433 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:20.207438 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:20.207448 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:47:20.207494 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:20.207496 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:20.207511 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:20.207587 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:20.207836 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.208558 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.210152 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.210785 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.210862 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.210919 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:20.211158 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 16:47:20.211215 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":120,"threads_started":1}
I20260811 16:47:20.211304 3973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.206654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:45507 (local address 127.0.0.1:46034)
0811 16:47:20.207036 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:20.207048 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:20.207107 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:20.207688 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:20.207689 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:20.207691 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:20.207751 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:20.207753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.208664 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.208665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:20.210021 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:20.210024 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.210905 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.210906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:20.210995 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.211013 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 16:47:20.211116 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 16:47:20.211228 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":48,"thread_start_us":120,"threads_started":1}
I20260811 16:47:20.211359 3975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.206678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58594 (local address 127.2.55.131:46743)
0811 16:47:20.206886 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:20.206891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:20.207156 (+ 265us) server_negotiation.cc:407] Connection header received
0811 16:47:20.207206 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:20.207208 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:20.207235 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:20.207321 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:20.207579 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.208869 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.210119 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.210792 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.210904 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.210968 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:20.211221 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 16:47:20.211276 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":89,"threads_started":1}
I20260811 16:47:20.211614 3978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.206929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:41639 (local address 127.0.0.1:38026)
0811 16:47:20.207466 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:20.207476 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:20.207541 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:20.207840 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:20.207841 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:20.207843 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:20.207889 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:20.207890 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.209265 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.209267 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:20.210394 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:20.210397 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.211374 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.211375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:20.211451 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.211455 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:20.211511 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 16:47:20.211548 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":82,"threads_started":1}
I20260811 16:47:20.211720 3979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.207168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38026 (local address 127.2.55.130:41639)
0811 16:47:20.207407 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:20.207412 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:20.207626 (+ 214us) server_negotiation.cc:407] Connection header received
0811 16:47:20.207671 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:20.207673 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:20.207688 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:20.207756 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:20.207960 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.209146 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.210498 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.211228 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.211290 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.211339 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:20.211563 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 16:47:20.211617 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":122,"threads_started":1}
I20260811 16:47:20.211810 3974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.206592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:46743 (local address 127.0.0.1:58594)
0811 16:47:20.206903 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:20.206948 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:20.207031 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:20.207369 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:20.207374 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:20.207377 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:20.207464 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:20.207466 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.208965 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.208966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:20.210021 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:20.210024 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.210967 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.210968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:20.211043 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.211048 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:47:20.211106 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 16:47:20.211738 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":548,"thread_start_us":70,"threads_started":1}
I20260811 16:47:20.212618 3418 tablet_service.cc:1467] Processing CreateTablet for tablet 56f8614aa7b046a7a604356cf62f523b (DEFAULT_TABLE table=test-table [id=60be04b40a0d4d1b828fc8abe06f2344]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:20.212630 3637 tablet_service.cc:1467] Processing CreateTablet for tablet 56f8614aa7b046a7a604356cf62f523b (DEFAULT_TABLE table=test-table [id=60be04b40a0d4d1b828fc8abe06f2344]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:20.213055 3637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56f8614aa7b046a7a604356cf62f523b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:20.213055 3418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56f8614aa7b046a7a604356cf62f523b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:20.213490 3860 tablet_service.cc:1467] Processing CreateTablet for tablet 56f8614aa7b046a7a604356cf62f523b (DEFAULT_TABLE table=test-table [id=60be04b40a0d4d1b828fc8abe06f2344]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:20.213865 3860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56f8614aa7b046a7a604356cf62f523b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:20.216801 3982 tablet_bootstrap.cc:492] T 56f8614aa7b046a7a604356cf62f523b P 249558e04f2f4d5395e33b7d680abe5f: Bootstrap starting.
I20260811 16:47:20.217041 3983 tablet_bootstrap.cc:492] T 56f8614aa7b046a7a604356cf62f523b P 250841de0727494696e7d10b1388eb43: Bootstrap starting.
I20260811 16:47:20.217577 3983 tablet_bootstrap.cc:654] T 56f8614aa7b046a7a604356cf62f523b P 250841de0727494696e7d10b1388eb43: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:20.217736 3982 tablet_bootstrap.cc:654] T 56f8614aa7b046a7a604356cf62f523b P 249558e04f2f4d5395e33b7d680abe5f: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:20.218232 3983 log.cc:824] T 56f8614aa7b046a7a604356cf62f523b P 250841de0727494696e7d10b1388eb43: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:20.218232 3982 log.cc:824] T 56f8614aa7b046a7a604356cf62f523b P 249558e04f2f4d5395e33b7d680abe5f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:20.219002 3983 tablet_bootstrap.cc:492] T 56f8614aa7b046a7a604356cf62f523b P 250841de0727494696e7d10b1388eb43: No bootstrap required, opened a new log
I20260811 16:47:20.219064 3983 ts_tablet_manager.cc:1397] T 56f8614aa7b046a7a604356cf62f523b P 250841de0727494696e7d10b1388eb43: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:47:20.219265 3982 tablet_bootstrap.cc:492] T 56f8614aa7b046a7a604356cf62f523b P 249558e04f2f4d5395e33b7d680abe5f: No bootstrap required, opened a new log
I20260811 16:47:20.219347 3982 ts_tablet_manager.cc:1397] T 56f8614aa7b046a7a604356cf62f523b P 249558e04f2f4d5395e33b7d680abe5f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 16:47:20.219823 3984 tablet_bootstrap.cc:492] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017: Bootstrap starting.
I20260811 16:47:20.220685 3984 tablet_bootstrap.cc:654] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:20.221127 3982 raft_consensus.cc:348] T 56f8614aa7b046a7a604356cf62f523b P 249558e04f2f4d5395e33b7d680abe5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249558e04f2f4d5395e33b7d680abe5f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46743 } } peers { permanent_uuid: "a666e9dace3d4596975591238b6d0017" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45507 } } peers { permanent_uuid: "250841de0727494696e7d10b1388eb43" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41639 } }
I20260811 16:47:20.221292 3982 raft_consensus.cc:374] T 56f8614aa7b046a7a604356cf62f523b P 249558e04f2f4d5395e33b7d680abe5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:20.221282 3984 log.cc:824] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:20.221338 3982 raft_consensus.cc:729] T 56f8614aa7b046a7a604356cf62f523b P 249558e04f2f4d5395e33b7d680abe5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 249558e04f2f4d5395e33b7d680abe5f, State: Initialized, Role: FOLLOWER
I20260811 16:47:20.221284 3983 raft_consensus.cc:348] T 56f8614aa7b046a7a604356cf62f523b P 250841de0727494696e7d10b1388eb43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249558e04f2f4d5395e33b7d680abe5f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46743 } } peers { permanent_uuid: "a666e9dace3d4596975591238b6d0017" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45507 } } peers { permanent_uuid: "250841de0727494696e7d10b1388eb43" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41639 } }
I20260811 16:47:20.221482 3983 raft_consensus.cc:374] T 56f8614aa7b046a7a604356cf62f523b P 250841de0727494696e7d10b1388eb43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:20.221498 3982 consensus_queue.cc:260] T 56f8614aa7b046a7a604356cf62f523b P 249558e04f2f4d5395e33b7d680abe5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249558e04f2f4d5395e33b7d680abe5f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46743 } } peers { permanent_uuid: "a666e9dace3d4596975591238b6d0017" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45507 } } peers { permanent_uuid: "250841de0727494696e7d10b1388eb43" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41639 } }
I20260811 16:47:20.221546 3983 raft_consensus.cc:729] T 56f8614aa7b046a7a604356cf62f523b P 250841de0727494696e7d10b1388eb43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 250841de0727494696e7d10b1388eb43, State: Initialized, Role: FOLLOWER
I20260811 16:47:20.221685 3983 consensus_queue.cc:260] T 56f8614aa7b046a7a604356cf62f523b P 250841de0727494696e7d10b1388eb43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249558e04f2f4d5395e33b7d680abe5f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46743 } } peers { permanent_uuid: "a666e9dace3d4596975591238b6d0017" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45507 } } peers { permanent_uuid: "250841de0727494696e7d10b1388eb43" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41639 } }
I20260811 16:47:20.221848 3982 ts_tablet_manager.cc:1428] T 56f8614aa7b046a7a604356cf62f523b P 249558e04f2f4d5395e33b7d680abe5f: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260811 16:47:20.222000 3983 ts_tablet_manager.cc:1428] T 56f8614aa7b046a7a604356cf62f523b P 250841de0727494696e7d10b1388eb43: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:47:20.222033 3958 heartbeater.cc:503] Master 127.2.55.190:40223 was elected leader, sending a full tablet report...
I20260811 16:47:20.222028 3750 heartbeater.cc:503] Master 127.2.55.190:40223 was elected leader, sending a full tablet report...
I20260811 16:47:20.222427 3984 tablet_bootstrap.cc:492] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017: No bootstrap required, opened a new log
I20260811 16:47:20.222494 3984 ts_tablet_manager.cc:1397] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 16:47:20.224324 3984 raft_consensus.cc:348] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249558e04f2f4d5395e33b7d680abe5f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46743 } } peers { permanent_uuid: "a666e9dace3d4596975591238b6d0017" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45507 } } peers { permanent_uuid: "250841de0727494696e7d10b1388eb43" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41639 } }
I20260811 16:47:20.224509 3984 raft_consensus.cc:374] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:20.224538 3984 raft_consensus.cc:729] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a666e9dace3d4596975591238b6d0017, State: Initialized, Role: FOLLOWER
I20260811 16:47:20.224658 3984 consensus_queue.cc:260] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249558e04f2f4d5395e33b7d680abe5f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46743 } } peers { permanent_uuid: "a666e9dace3d4596975591238b6d0017" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45507 } } peers { permanent_uuid: "250841de0727494696e7d10b1388eb43" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41639 } }
I20260811 16:47:20.224987 3984 ts_tablet_manager.cc:1428] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 16:47:20.224996 3527 heartbeater.cc:503] Master 127.2.55.190:40223 was elected leader, sending a full tablet report...
W20260811 16:47:20.255209 3751 tablet.cc:2369] T 56f8614aa7b046a7a604356cf62f523b P 250841de0727494696e7d10b1388eb43: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:47:20.275081 3993 raft_consensus.cc:482] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:20.275281 3993 raft_consensus.cc:504] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249558e04f2f4d5395e33b7d680abe5f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46743 } } peers { permanent_uuid: "a666e9dace3d4596975591238b6d0017" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45507 } } peers { permanent_uuid: "250841de0727494696e7d10b1388eb43" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41639 } }
I20260811 16:47:20.275983 3993 leader_election.cc:288] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 249558e04f2f4d5395e33b7d680abe5f (127.2.55.131:46743), 250841de0727494696e7d10b1388eb43 (127.2.55.130:41639)
I20260811 16:47:20.278975 3979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.276341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:55015 (local address 127.2.55.130:41639)
0811 16:47:20.276386 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:20.276388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:20.276401 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:47:20.276477 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:20.276478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:20.276491 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:20.276576 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:20.276743 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.277275 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.278225 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.278612 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.278702 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.278712 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:20.278863 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 16:47:20.278902 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:47:20.278975 3533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.276279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:41639 (local address 127.2.55.129:55015)
0811 16:47:20.276358 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:20.276372 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:20.276419 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:20.276581 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:20.276583 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:20.276584 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:20.276667 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:20.276669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.277365 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.277366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:20.278126 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:20.278128 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.278698 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.278699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:20.278786 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.278789 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:47:20.278864 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 16:47:20.278902 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 16:47:20.279493 3995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.276327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:46743 (local address 127.2.55.129:54917)
0811 16:47:20.276558 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:20.276568 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:20.276659 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:20.276869 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:20.276870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:20.276871 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:20.276954 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:20.276955 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.277662 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.277663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:20.278545 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:20.278548 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.279299 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.279300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:20.279368 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.279371 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:47:20.279417 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 16:47:20.279444 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":137,"threads_started":1}
I20260811 16:47:20.279455 3672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56f8614aa7b046a7a604356cf62f523b" candidate_uuid: "a666e9dace3d4596975591238b6d0017" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "250841de0727494696e7d10b1388eb43" is_pre_election: true
I20260811 16:47:20.279584 3975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.276393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:54917 (local address 127.2.55.131:46743)
0811 16:47:20.276455 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:20.276458 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:20.276652 (+ 194us) server_negotiation.cc:407] Connection header received
0811 16:47:20.276736 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:20.276737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:20.276751 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:20.276839 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:20.277048 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.277560 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.278665 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.279193 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.279278 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.279289 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:20.279461 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 16:47:20.279514 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:47:20.279958 3889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56f8614aa7b046a7a604356cf62f523b" candidate_uuid: "a666e9dace3d4596975591238b6d0017" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "249558e04f2f4d5395e33b7d680abe5f" is_pre_election: true
I20260811 16:47:20.280107 3889 raft_consensus.cc:2454] T 56f8614aa7b046a7a604356cf62f523b P 249558e04f2f4d5395e33b7d680abe5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a666e9dace3d4596975591238b6d0017 in term 0.
I20260811 16:47:20.279765 3672 raft_consensus.cc:2454] T 56f8614aa7b046a7a604356cf62f523b P 250841de0727494696e7d10b1388eb43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a666e9dace3d4596975591238b6d0017 in term 0.
I20260811 16:47:20.280395 3346 leader_election.cc:302] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 249558e04f2f4d5395e33b7d680abe5f, a666e9dace3d4596975591238b6d0017; no voters:
I20260811 16:47:20.280581 3993 raft_consensus.cc:2781] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:20.280675 3993 raft_consensus.cc:482] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:20.280699 3993 raft_consensus.cc:3037] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:20.281684 3993 raft_consensus.cc:504] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249558e04f2f4d5395e33b7d680abe5f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46743 } } peers { permanent_uuid: "a666e9dace3d4596975591238b6d0017" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45507 } } peers { permanent_uuid: "250841de0727494696e7d10b1388eb43" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41639 } }
I20260811 16:47:20.281849 3993 leader_election.cc:288] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [CANDIDATE]: Term 1 election: Requested vote from peers 249558e04f2f4d5395e33b7d680abe5f (127.2.55.131:46743), 250841de0727494696e7d10b1388eb43 (127.2.55.130:41639)
I20260811 16:47:20.282048 3672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56f8614aa7b046a7a604356cf62f523b" candidate_uuid: "a666e9dace3d4596975591238b6d0017" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "250841de0727494696e7d10b1388eb43"
I20260811 16:47:20.282168 3672 raft_consensus.cc:3037] T 56f8614aa7b046a7a604356cf62f523b P 250841de0727494696e7d10b1388eb43 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:20.282197 3889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56f8614aa7b046a7a604356cf62f523b" candidate_uuid: "a666e9dace3d4596975591238b6d0017" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "249558e04f2f4d5395e33b7d680abe5f"
I20260811 16:47:20.282274 3889 raft_consensus.cc:3037] T 56f8614aa7b046a7a604356cf62f523b P 249558e04f2f4d5395e33b7d680abe5f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:20.283218 3672 raft_consensus.cc:2454] T 56f8614aa7b046a7a604356cf62f523b P 250841de0727494696e7d10b1388eb43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a666e9dace3d4596975591238b6d0017 in term 1.
I20260811 16:47:20.283274 3889 raft_consensus.cc:2454] T 56f8614aa7b046a7a604356cf62f523b P 249558e04f2f4d5395e33b7d680abe5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a666e9dace3d4596975591238b6d0017 in term 1.
I20260811 16:47:20.283430 3346 leader_election.cc:302] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 249558e04f2f4d5395e33b7d680abe5f, a666e9dace3d4596975591238b6d0017; no voters:
I20260811 16:47:20.283551 3993 raft_consensus.cc:2781] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:20.283747 3993 raft_consensus.cc:686] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [term 1 LEADER]: Becoming Leader. State: Replica: a666e9dace3d4596975591238b6d0017, State: Running, Role: LEADER
I20260811 16:47:20.283890 3993 consensus_queue.cc:237] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249558e04f2f4d5395e33b7d680abe5f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46743 } } peers { permanent_uuid: "a666e9dace3d4596975591238b6d0017" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45507 } } peers { permanent_uuid: "250841de0727494696e7d10b1388eb43" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41639 } }
I20260811 16:47:20.285104 3222 catalog_manager.cc:5495] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017 reported cstate change: term changed from 0 to 1, leader changed from <none> to a666e9dace3d4596975591238b6d0017 (127.2.55.129). New cstate: current_term: 1 leader_uuid: "a666e9dace3d4596975591238b6d0017" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "249558e04f2f4d5395e33b7d680abe5f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a666e9dace3d4596975591238b6d0017" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "250841de0727494696e7d10b1388eb43" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41639 } health_report { overall_health: UNKNOWN } } }
Aug 11 16:47:20 dist-test-slave-3h5h krb5kdc[3150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466839, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.129@KRBTEST.COM
I20260811 16:47:20.308969 3977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.300237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46042 (local address 127.2.55.129:45507)
0811 16:47:20.300316 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:20.300320 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:20.300480 (+ 160us) server_negotiation.cc:407] Connection header received
0811 16:47:20.300528 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:20.300529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:20.300543 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:20.300601 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:20.301353 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.301825 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.302740 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.302934 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.302996 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.305814 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:20.305825 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:20.305826 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:20.305834 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:20.307640 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:20.308107 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:20.308110 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:20.308110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:20.308169 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:20.308408 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:20.308408 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:20.308409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:20.308565 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:20.308671 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:20.308773 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 16:47:20.308898 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 16:47:20.316268 3531 tablet.cc:2369] T 56f8614aa7b046a7a604356cf62f523b P a666e9dace3d4596975591238b6d0017: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 16:47:20 dist-test-slave-3h5h krb5kdc[3150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466840, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 16:47:20 dist-test-slave-3h5h krb5kdc[3150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466840, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.2.55.129@KRBTEST.COM
I20260811 16:47:20.335429 3977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.327809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46052 (local address 127.2.55.129:45507)
0811 16:47:20.327885 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:20.327888 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:20.328007 (+ 119us) server_negotiation.cc:407] Connection header received
0811 16:47:20.328178 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:20.328179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:20.328197 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:20.328264 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:20.328869 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.329366 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.330106 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.330301 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.330373 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.332690 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:20.332692 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:20.332693 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:20.332708 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:20.334156 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:20.334545 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:20.334546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:20.334547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:20.334608 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:20.334813 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:20.334814 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:20.334815 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:20.334928 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:20.335042 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:20.335237 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 16:47:20.335323 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 16:47:20 dist-test-slave-3h5h krb5kdc[3150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 16:47:20 dist-test-slave-3h5h krb5kdc[3150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.129@KRBTEST.COM
I20260811 16:47:20.362551 3977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:20.354299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46068 (local address 127.2.55.129:45507)
0811 16:47:20.354390 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:20.354393 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:20.354505 (+ 112us) server_negotiation.cc:407] Connection header received
0811 16:47:20.354583 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:20.354584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:20.354598 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:20.354672 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:20.355331 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.355817 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.356581 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:20.356800 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:20.356973 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:20.359780 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:20.359782 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:20.359782 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:20.359791 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:20.361295 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:20.361636 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:20.361637 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:20.361638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:20.361693 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:20.361867 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:20.361868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:20.361868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:20.361964 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:20.362047 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:20.362364 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 16:47:20.362469 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 16:47:20.363482 3386 tablet_service.cc:2908] Rejecting scan request for tablet 56f8614aa7b046a7a604356cf62f523b: Uninitialized: clean time has not yet been initialized
I20260811 16:47:20.364668 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 3318
I20260811 16:47:20.378995 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 3537
I20260811 16:47:20.391839 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 3758
I20260811 16:47:20.407778 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 3172
2026-08-11T16:47:20Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2349 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:47:20 dist-test-slave-3h5h krb5kdc[4017](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:47:20 dist-test-slave-3h5h krb5kdc[4017](info): set up 2 sockets
Aug 11 16:47:20 dist-test-slave-3h5h krb5kdc[4017](info): commencing operation
krb5kdc: starting...
W20260811 16:47:21.692554 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:47:21 dist-test-slave-3h5h krb5kdc[4017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:47:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:47:21.824445 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:44905
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:45455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:44905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:21.918781 4045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:21.919062 4045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:21.919126 4045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:21.920821 4045 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:21.920893 4045 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 16:47:21.920912 4045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:21.920958 4045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:21.921036 4045 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:21.921056 4045 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:21.923693 4045 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:45455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:44905
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:44905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4045
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:21.923995 4045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:21.924306 4045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:21.930220 4052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:21.930243 4053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:21.930838 4056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:21.930974 4045 server_base.cc:1034] running on GCE node
I20260811 16:47:21.931231 4045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:21.931665 4045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:21.932863 4045 hybrid_clock.cc:648] HybridClock initialized: now 1786466841932812 us; error 39 us; skew 500 ppm
Aug 11 16:47:21 dist-test-slave-3h5h krb5kdc[4017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466841, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:21.936272 4045 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:47:21.936923 4045 webserver.cc:460] Webserver started at http://127.2.55.190:43491/ using document root <none> and password file <none>
I20260811 16:47:21.937192 4045 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:21.937239 4045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:21.937386 4045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:21.938994 4045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "414769fa25dd4163b5320b1316364761"
format_stamp: "Formatted at 2026-08-11 16:47:21 on dist-test-slave-3h5h"
server_key: "17a721f13375e013fbb4711b4562f69a"
server_key_iv: "36f9feddbb719b6e0581d9809d5aed0b"
server_key_version: "encryptionkey@0"
I20260811 16:47:21.939448 4045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "414769fa25dd4163b5320b1316364761"
format_stamp: "Formatted at 2026-08-11 16:47:21 on dist-test-slave-3h5h"
server_key: "17a721f13375e013fbb4711b4562f69a"
server_key_iv: "36f9feddbb719b6e0581d9809d5aed0b"
server_key_version: "encryptionkey@0"
I20260811 16:47:21.941797 4045 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.003s
I20260811 16:47:21.942755 4072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:21.942925 4045 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:21.943027 4045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "414769fa25dd4163b5320b1316364761"
format_stamp: "Formatted at 2026-08-11 16:47:21 on dist-test-slave-3h5h"
server_key: "17a721f13375e013fbb4711b4562f69a"
server_key_iv: "36f9feddbb719b6e0581d9809d5aed0b"
server_key_version: "encryptionkey@0"
I20260811 16:47:21.943109 4045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:21.958757 4045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:21.961272 4045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:21.961439 4045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:21.967072 4045 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:44905
I20260811 16:47:21.967147 4164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:44905 every 8 connection(s)
I20260811 16:47:21.967479 4045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:21.968197 4168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:21.970453 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 4045
I20260811 16:47:21.970575 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:21.970752 2270 external_mini_cluster.cc:1428] Setting key 3d8d0bdb195fca39d19e5b316f48dcb0
I20260811 16:47:21.970752 4168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761: Bootstrap starting.
I20260811 16:47:21.971643 4168 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:21.971990 4168 log.cc:824] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:21.972790 4168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761: No bootstrap required, opened a new log
I20260811 16:47:21.975306 4168 raft_consensus.cc:348] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "414769fa25dd4163b5320b1316364761" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44905 } }
I20260811 16:47:21.975459 4168 raft_consensus.cc:374] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:21.975483 4168 raft_consensus.cc:729] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414769fa25dd4163b5320b1316364761, State: Initialized, Role: FOLLOWER
I20260811 16:47:21.975630 4168 consensus_queue.cc:260] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "414769fa25dd4163b5320b1316364761" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44905 } }
I20260811 16:47:21.975726 4168 raft_consensus.cc:388] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:21.975771 4168 raft_consensus.cc:482] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:21.975821 4168 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:21.976419 4168 raft_consensus.cc:504] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "414769fa25dd4163b5320b1316364761" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44905 } }
I20260811 16:47:21.976547 4168 leader_election.cc:302] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 414769fa25dd4163b5320b1316364761; no voters:
I20260811 16:47:21.976759 4168 leader_election.cc:288] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:21.976815 4174 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:21.977075 4168 sys_catalog.cc:564] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:21.978127 4174 raft_consensus.cc:686] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [term 1 LEADER]: Becoming Leader. State: Replica: 414769fa25dd4163b5320b1316364761, State: Running, Role: LEADER
I20260811 16:47:21.978242 4174 consensus_queue.cc:237] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "414769fa25dd4163b5320b1316364761" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44905 } }
Aug 11 16:47:21 dist-test-slave-3h5h krb5kdc[4017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:21.978832 4186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 414769fa25dd4163b5320b1316364761. Latest consensus state: current_term: 1 leader_uuid: "414769fa25dd4163b5320b1316364761" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "414769fa25dd4163b5320b1316364761" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44905 } } }
I20260811 16:47:21.978948 4175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "414769fa25dd4163b5320b1316364761" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "414769fa25dd4163b5320b1316364761" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44905 } } }
I20260811 16:47:21.979024 4175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:21.979023 4186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:21.979254 4195 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:21.979835 4195 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:21.981709 4195 catalog_manager.cc:1347] Generated new cluster ID: ad39c92a6db245d59403cca24bcb202a
I20260811 16:47:21.981761 4195 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:47:21.983011 4171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:21.971425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38656 (local address 127.2.55.190:44905)
0811 16:47:21.971662 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:21.971673 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:21.971710 (+ 37us) server_negotiation.cc:407] Connection header received
0811 16:47:21.972319 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:21.972328 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:21.972379 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:21.972550 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:21.973337 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:21.974830 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:21.975681 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:21.976262 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:21.976392 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:21.979257 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:21.979262 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:21.979262 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:21.979275 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:21.981356 (+ 2081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:21.981768 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:21.981772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:21.981773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:21.981875 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:21.982093 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:21.982094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:21.982094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:21.982380 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:21.982556 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:21.982679 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 16:47:21.982826 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":137,"threads_started":1}
I20260811 16:47:22.047820 4195 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:22.048686 4195 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:22.057401 4195 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761: Generated new TSK 0
I20260811 16:47:22.057610 4195 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:47:22.093163 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:44905
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:45455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:22.180400 4203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:22.180625 4203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:22.180653 4203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:22.181847 4203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:22.181896 4203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:22.181919 4203 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:47:22.181939 4203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:47:22.183336 4203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:45455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.55.190:44905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:22.183523 4203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:22.183707 4203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:22.189343 4214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:22.189308 4217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:22.189489 4203 server_base.cc:1034] running on GCE node
W20260811 16:47:22.189314 4212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:22.189767 4203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:22.190016 4203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:22.191186 4203 hybrid_clock.cc:648] HybridClock initialized: now 1786466842191157 us; error 40 us; skew 500 ppm
Aug 11 16:47:22 dist-test-slave-3h5h krb5kdc[4017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466842, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:22.194134 4203 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:47:22.194572 4203 webserver.cc:460] Webserver started at http://127.2.55.129:36669/ using document root <none> and password file <none>
I20260811 16:47:22.194808 4203 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:22.194876 4203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:22.195025 4203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:22.196136 4203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "b453360e9341406190458e39c7a6d9b5"
format_stamp: "Formatted at 2026-08-11 16:47:22 on dist-test-slave-3h5h"
server_key: "9d299188268b6c18a0ff5eb3796d1213"
server_key_iv: "9a83f6e53b404a7c0deef6231a7c3905"
server_key_version: "encryptionkey@0"
I20260811 16:47:22.196611 4203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "b453360e9341406190458e39c7a6d9b5"
format_stamp: "Formatted at 2026-08-11 16:47:22 on dist-test-slave-3h5h"
server_key: "9d299188268b6c18a0ff5eb3796d1213"
server_key_iv: "9a83f6e53b404a7c0deef6231a7c3905"
server_key_version: "encryptionkey@0"
I20260811 16:47:22.198069 4203 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:22.198849 4226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:22.199198 4203 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:22.199322 4203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "b453360e9341406190458e39c7a6d9b5"
format_stamp: "Formatted at 2026-08-11 16:47:22 on dist-test-slave-3h5h"
server_key: "9d299188268b6c18a0ff5eb3796d1213"
server_key_iv: "9a83f6e53b404a7c0deef6231a7c3905"
server_key_version: "encryptionkey@0"
I20260811 16:47:22.199406 4203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:22.221131 4203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:22.223537 4203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:22.223726 4203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:22.224292 4203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:22.224352 4203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:22.224387 4203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:22.224426 4203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:22.232223 4203 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:46431
I20260811 16:47:22.232384 4397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:46431 every 8 connection(s)
Aug 11 16:47:22 dist-test-slave-3h5h krb5kdc[4017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466842, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:22.232708 4203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:47:22.236151 4171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.225145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:46587 (local address 127.2.55.190:44905)
0811 16:47:22.225202 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:22.225205 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:22.225383 (+ 178us) server_negotiation.cc:407] Connection header received
0811 16:47:22.226182 (+ 799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:22.226184 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:22.226199 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:22.226237 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:22.227297 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.228247 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.229976 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.230201 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.230268 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.233350 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:22.233352 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:22.233352 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:22.233360 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:22.234727 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:22.235248 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:22.235250 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:22.235250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:22.235316 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:22.235575 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:22.235575 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:22.235576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:22.235687 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:22.235744 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:22.235992 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 16:47:22.236069 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 16:47:22.236447 4237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.225013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:44905 (local address 127.2.55.129:46587)
0811 16:47:22.225224 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:22.225278 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:22.226029 (+ 751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:22.226450 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:22.226456 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:22.226876 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:22.227179 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.227186 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.228365 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.228367 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.229877 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.229880 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.230295 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.230296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.230463 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.231143 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:22.231157 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:22.233212 (+ 2055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:22.234880 (+ 1668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:22.234888 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:22.234890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:22.235175 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:22.235380 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:22.235380 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:22.235381 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:22.235510 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:22.235746 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:22.235752 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:22.235876 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 16:47:22.236037 (+ 161us) client_negotiation.cc:240] Negotiation successful
0811 16:47:22.236179 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":103,"threads_started":1}
I20260811 16:47:22.237056 4398 heartbeater.cc:347] Connected to a master server at 127.2.55.190:44905
I20260811 16:47:22.237205 4398 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:22.237428 4398 heartbeater.cc:511] Master 127.2.55.190:44905 requested a full tablet report, sending...
I20260811 16:47:22.238236 4095 ts_manager.cc:194] Registered new tserver with Master: b453360e9341406190458e39c7a6d9b5 (127.2.55.129:46431)
I20260811 16:47:22.239293 4095 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:46587
I20260811 16:47:22.239400 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 4203
I20260811 16:47:22.239537 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:47:22.239758 2270 external_mini_cluster.cc:1428] Setting key b703bba20ca146328ad5749953473839
I20260811 16:47:22.244994 4411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.238372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:44905 (local address 127.2.55.129:37311)
0811 16:47:22.238531 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:22.238543 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:22.238605 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:22.238735 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:22.238736 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:22.238959 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:22.239021 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.239022 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.239939 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.239940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.240664 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.240666 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.241162 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.241163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.241246 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.241715 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:22.241721 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:22.242021 (+ 300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:22.243915 (+ 1894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:22.243916 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:22.243916 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:22.244104 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:22.244329 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:22.244329 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:22.244329 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:22.244385 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:22.244672 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:22.244672 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:22.244710 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 16:47:22.244766 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 16:47:22.244917 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":32,"thread_start_us":74,"threads_started":1}
I20260811 16:47:22.245127 4171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.238477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:37311 (local address 127.2.55.190:44905)
0811 16:47:22.238516 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:22.238518 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:22.238597 (+ 79us) server_negotiation.cc:407] Connection header received
0811 16:47:22.238665 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:22.238666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:22.238674 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:22.238721 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:22.239089 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.239814 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.240759 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.241057 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.241158 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.242151 (+ 993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:22.242152 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:22.242153 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:22.242160 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:22.243815 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:22.244186 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:22.244187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:22.244188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:22.244254 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:22.244451 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:22.244452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:22.244452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:22.244602 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:22.244677 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:22.244818 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 16:47:22.244965 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:47:22.272344 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:44905
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:45455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:22.356554 4414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:22.356781 4414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:22.356822 4414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:22.357995 4414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:22.358062 4414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:22.358095 4414 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:47:22.358137 4414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:47:22.359594 4414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:45455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.55.190:44905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:22.359863 4414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:22.360129 4414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:22.365959 4420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:22.365972 4421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:22.365979 4424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:22.366281 4414 server_base.cc:1034] running on GCE node
I20260811 16:47:22.366480 4414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:22.366736 4414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:22.367882 4414 hybrid_clock.cc:648] HybridClock initialized: now 1786466842367869 us; error 31 us; skew 500 ppm
Aug 11 16:47:22 dist-test-slave-3h5h krb5kdc[4017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466842, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:22.373847 4414 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:47:22.374400 4414 webserver.cc:460] Webserver started at http://127.2.55.130:36077/ using document root <none> and password file <none>
I20260811 16:47:22.374663 4414 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:22.374716 4414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:22.374882 4414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:22.376058 4414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "b027d8c0b60e4ef682a3067b51c05808"
format_stamp: "Formatted at 2026-08-11 16:47:22 on dist-test-slave-3h5h"
server_key: "41427386ba9c355f399380986fdd5b7b"
server_key_iv: "f6297d8e37b67f022d7773d19f449ab8"
server_key_version: "encryptionkey@0"
I20260811 16:47:22.376437 4414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "b027d8c0b60e4ef682a3067b51c05808"
format_stamp: "Formatted at 2026-08-11 16:47:22 on dist-test-slave-3h5h"
server_key: "41427386ba9c355f399380986fdd5b7b"
server_key_iv: "f6297d8e37b67f022d7773d19f449ab8"
server_key_version: "encryptionkey@0"
I20260811 16:47:22.378315 4414 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 16:47:22.379228 4432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:22.379405 4414 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:22.379504 4414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "b027d8c0b60e4ef682a3067b51c05808"
format_stamp: "Formatted at 2026-08-11 16:47:22 on dist-test-slave-3h5h"
server_key: "41427386ba9c355f399380986fdd5b7b"
server_key_iv: "f6297d8e37b67f022d7773d19f449ab8"
server_key_version: "encryptionkey@0"
I20260811 16:47:22.379585 4414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:22.388187 4414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:22.390364 4414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:22.390525 4414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:22.391074 4414 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:22.391130 4414 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:22.391192 4414 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:22.391214 4414 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:47:22 dist-test-slave-3h5h krb5kdc[4017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466842, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:22.398655 4414 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:36265
I20260811 16:47:22.398726 4611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:36265 every 8 connection(s)
I20260811 16:47:22.399111 4414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:47:22.401269 4171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.391612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:40801 (local address 127.2.55.190:44905)
0811 16:47:22.391681 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:22.391684 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:22.391885 (+ 201us) server_negotiation.cc:407] Connection header received
0811 16:47:22.392438 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:22.392439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:22.392452 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:22.392517 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:22.393245 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.393771 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.394776 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.395001 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.395078 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.398019 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:22.398021 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:22.398021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:22.398037 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:22.399744 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:22.400257 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:22.400258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:22.400259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:22.400326 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:22.400574 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:22.400575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:22.400575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:22.400703 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:22.400781 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:22.401130 (+ 349us) server_negotiation.cc:299] Negotiation successful
0811 16:47:22.401204 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:47:22.401340 4449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.391558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:44905 (local address 127.2.55.130:40801)
0811 16:47:22.391744 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:22.391791 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:22.392328 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:22.392592 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:22.392596 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:22.392960 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:22.393150 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.393155 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.393867 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.393868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.394681 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.394683 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.395085 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.395087 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.395219 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.395738 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:22.395746 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:22.397904 (+ 2158us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:22.399819 (+ 1915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:22.399823 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:22.399825 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:22.400041 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:22.400397 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:22.400398 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:22.400398 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:22.400491 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:22.400780 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:22.400785 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:22.400970 (+ 185us) client_negotiation.cc:769] Sending connection context
0811 16:47:22.401059 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 16:47:22.401184 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":105,"threads_started":1}
I20260811 16:47:22.401947 4612 heartbeater.cc:347] Connected to a master server at 127.2.55.190:44905
I20260811 16:47:22.402065 4612 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:22.402266 4612 heartbeater.cc:511] Master 127.2.55.190:44905 requested a full tablet report, sending...
I20260811 16:47:22.402678 4095 ts_manager.cc:194] Registered new tserver with Master: b027d8c0b60e4ef682a3067b51c05808 (127.2.55.130:36265)
I20260811 16:47:22.403263 4095 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:40801
I20260811 16:47:22.408178 4171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.403183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:50173 (local address 127.2.55.190:44905)
0811 16:47:22.403237 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:22.403239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:22.403336 (+ 97us) server_negotiation.cc:407] Connection header received
0811 16:47:22.403429 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:22.403430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:22.403446 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:22.403495 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:22.403855 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.404397 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.405158 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.405338 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.405394 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.406165 (+ 771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:22.406166 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:22.406166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:22.406172 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:22.407284 (+ 1112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:22.407579 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:22.407579 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:22.407580 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:22.407628 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:22.407766 (+ 138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:22.407767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:22.407767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:22.407896 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:22.407946 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:22.408056 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 16:47:22.408118 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:47:22.408198 4623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.403109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:44905 (local address 127.2.55.130:50173)
0811 16:47:22.403241 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:22.403253 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:22.403329 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:22.403509 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:22.403510 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:22.403727 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:22.403778 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.403780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.404482 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.404482 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.405085 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.405087 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.405401 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.405401 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.405457 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.405819 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:22.405823 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:22.406087 (+ 264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:22.407356 (+ 1269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:22.407357 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:22.407357 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:22.407517 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:22.407677 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:22.407677 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:22.407678 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:22.407722 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:22.407951 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:22.407952 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:22.407988 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 16:47:22.408040 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 16:47:22.408118 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":71,"threads_started":1}
I20260811 16:47:22.408561 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 4414
I20260811 16:47:22.408653 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:47:22.408865 2270 external_mini_cluster.cc:1428] Setting key 6b6859ac90b61f7513b9aab245f77151
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:47:22.436355 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:44905
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:45455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:22.522231 4628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:22.522441 4628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:22.522466 4628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:22.523579 4628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:22.523614 4628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:22.523634 4628 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:47:22.523651 4628 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:47:22.525087 4628 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:45455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.55.190:44905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:22.525274 4628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:22.525449 4628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:22.530681 4634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:22.530756 4628 server_base.cc:1034] running on GCE node
W20260811 16:47:22.530689 4637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:22.530712 4635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:22.531106 4628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:22.531351 4628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:22.532486 4628 hybrid_clock.cc:648] HybridClock initialized: now 1786466842532474 us; error 28 us; skew 500 ppm
Aug 11 16:47:22 dist-test-slave-3h5h krb5kdc[4017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466842, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:22.535002 4628 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:47:22.535441 4628 webserver.cc:460] Webserver started at http://127.2.55.131:39437/ using document root <none> and password file <none>
I20260811 16:47:22.535666 4628 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:22.535733 4628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:22.535881 4628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:22.537134 4628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e"
format_stamp: "Formatted at 2026-08-11 16:47:22 on dist-test-slave-3h5h"
server_key: "cbaa540baad89d712e6c5a5bfd9ee10d"
server_key_iv: "6a15c590421cbb65aae0eb74ee86b020"
server_key_version: "encryptionkey@0"
I20260811 16:47:22.537557 4628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e"
format_stamp: "Formatted at 2026-08-11 16:47:22 on dist-test-slave-3h5h"
server_key: "cbaa540baad89d712e6c5a5bfd9ee10d"
server_key_iv: "6a15c590421cbb65aae0eb74ee86b020"
server_key_version: "encryptionkey@0"
I20260811 16:47:22.539155 4628 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:47:22.539875 4647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:22.540145 4628 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:22.540227 4628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e"
format_stamp: "Formatted at 2026-08-11 16:47:22 on dist-test-slave-3h5h"
server_key: "cbaa540baad89d712e6c5a5bfd9ee10d"
server_key_iv: "6a15c590421cbb65aae0eb74ee86b020"
server_key_version: "encryptionkey@0"
I20260811 16:47:22.540316 4628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:22.563035 4628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:22.565454 4628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:22.565632 4628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:22.566243 4628 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:22.566303 4628 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:22.566336 4628 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:22.566363 4628 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:22.573177 4628 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:36057
I20260811 16:47:22.573283 4835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:36057 every 8 connection(s)
Aug 11 16:47:22 dist-test-slave-3h5h krb5kdc[4017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466842, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:22.573576 4628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:47:22.577229 4171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.566731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:53909 (local address 127.2.55.190:44905)
0811 16:47:22.566806 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:22.566809 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:22.567050 (+ 241us) server_negotiation.cc:407] Connection header received
0811 16:47:22.567591 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:22.567593 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:22.567608 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:22.567698 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:22.568588 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.569487 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.571094 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.571410 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.571491 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.574210 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:22.574212 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:22.574212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:22.574219 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:22.575645 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:22.576132 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:22.576133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:22.576133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:22.576209 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:22.576502 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:22.576502 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:22.576503 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:22.576611 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:22.576661 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:22.577012 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 16:47:22.577129 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 16:47:22.577503 4666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.566739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:44905 (local address 127.2.55.131:53909)
0811 16:47:22.566904 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:22.566947 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:22.567456 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:22.567777 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:22.567782 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:22.568169 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:22.568475 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.568482 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.569588 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.569589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.570976 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.570980 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.571495 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.571496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.571600 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.572220 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:22.572230 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:22.574116 (+ 1886us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:22.575725 (+ 1609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:22.575732 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:22.575734 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:22.576058 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:22.576293 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:22.576295 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:22.576295 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:22.576427 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:22.576680 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:22.576686 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:22.576810 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 16:47:22.576991 (+ 181us) client_negotiation.cc:240] Negotiation successful
0811 16:47:22.577238 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":87,"threads_started":1}
I20260811 16:47:22.578024 4836 heartbeater.cc:347] Connected to a master server at 127.2.55.190:44905
I20260811 16:47:22.578111 4836 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:22.578351 4836 heartbeater.cc:511] Master 127.2.55.190:44905 requested a full tablet report, sending...
I20260811 16:47:22.578748 4095 ts_manager.cc:194] Registered new tserver with Master: afbd696a74d44bc1b6fe45c02bdd4d9e (127.2.55.131:36057)
I20260811 16:47:22.579147 4095 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:53909
I20260811 16:47:22.582326 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 4628
I20260811 16:47:22.582418 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:47:22.582630 2270 external_mini_cluster.cc:1428] Setting key e1807e2180f2b75b04467071d7b4cb27
I20260811 16:47:22.583808 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:47:22.585464 4171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.579299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:46933 (local address 127.2.55.190:44905)
0811 16:47:22.579342 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:22.579344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:22.579497 (+ 153us) server_negotiation.cc:407] Connection header received
0811 16:47:22.579544 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:22.579545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:22.579557 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:22.579587 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:22.580011 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.580532 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.581259 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.581452 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.581543 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.582582 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:22.582583 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:22.582584 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:22.582590 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:22.584213 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:22.584609 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:22.584609 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:22.584610 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:22.584661 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:22.584920 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:22.584921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:22.584921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:22.585031 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:22.585087 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:22.585277 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 16:47:22.585335 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:47:22.585610 4842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.579246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:44905 (local address 127.2.55.131:46933)
0811 16:47:22.579398 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:22.579408 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:22.579485 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:22.579653 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:22.579653 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:22.579854 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:22.579916 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.579918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.580627 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.580627 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.581188 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.581189 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.581545 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.581546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.581605 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.581991 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:22.581996 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:22.582505 (+ 509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:22.584290 (+ 1785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:22.584291 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:22.584292 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:22.584536 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:22.584724 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:22.584725 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:22.584725 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:22.584797 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:22.585095 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:22.585096 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:22.585150 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 16:47:22.585260 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 16:47:22.585402 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":81,"threads_started":1}
Aug 11 16:47:22 dist-test-slave-3h5h krb5kdc[4017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466842, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 16:47:22 dist-test-slave-3h5h krb5kdc[4017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466842, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:22.609519 4171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.601833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38662 (local address 127.2.55.190:44905)
0811 16:47:22.601891 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:22.601894 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:22.601906 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:47:22.602060 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:22.602062 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:22.602077 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:22.602150 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:22.602851 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.603432 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.604172 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.604384 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.604460 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.606860 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:22.606862 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:22.606862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:22.606869 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:22.608192 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:22.608549 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:22.608550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:22.608550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:22.608603 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:22.608769 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:22.608770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:22.608770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:22.609178 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:22.609263 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:22.609378 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 16:47:22.609447 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:47:22.611272 4095 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38662:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:47:22.612931 4095 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:22.619772 4867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.615395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:36057 (local address 127.0.0.1:41940)
0811 16:47:22.615563 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:22.615608 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:22.615679 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:22.616192 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:22.616196 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:22.616199 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:22.616331 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.616334 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.617459 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.617460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.618491 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.618494 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.619429 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.619430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.619524 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.619539 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 16:47:22.619620 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 16:47:22.619673 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":67,"threads_started":1}
I20260811 16:47:22.619781 4875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.615712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41940 (local address 127.2.55.131:36057)
0811 16:47:22.615921 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:22.615930 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:22.615940 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:47:22.615991 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:22.615993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:22.616092 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:22.616182 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:22.616442 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.617357 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.618597 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.619345 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.619416 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.619478 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:22.619644 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 16:47:22.619685 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":88,"threads_started":1}
I20260811 16:47:22.620064 4868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.615401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:46431 (local address 127.0.0.1:54668)
0811 16:47:22.615787 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:22.615797 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:22.615834 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:22.616650 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:22.616651 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:22.616653 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:22.616707 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.616709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.618111 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.618112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.618958 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.618960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.619851 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.619852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.619912 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.619916 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:22.619964 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 16:47:22.620000 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"mutex_wait_us":1,"thread_start_us":87,"threads_started":1}
I20260811 16:47:22.620393 4869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.615691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54668 (local address 127.2.55.129:46431)
0811 16:47:22.616108 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:22.616113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:22.616125 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:47:22.616165 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:22.616167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:22.616182 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:22.616251 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:22.616778 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.617954 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.619052 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.619697 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.619760 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.619813 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:22.620249 (+ 436us) server_negotiation.cc:299] Negotiation successful
0811 16:47:22.620293 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":97,"threads_started":1}
I20260811 16:47:22.620525 4862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.615417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:36265 (local address 127.0.0.1:41240)
0811 16:47:22.615890 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:22.615902 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:22.615962 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:22.616570 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:22.616571 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:22.616572 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:22.616607 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.616607 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.618117 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.618119 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.619243 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.619247 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.620285 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.620286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.620352 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.620355 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:47:22.620408 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 16:47:22.620453 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"mutex_wait_us":23,"thread_start_us":102,"threads_started":1}
I20260811 16:47:22.620764 4734 tablet_service.cc:1467] Processing CreateTablet for tablet 37b5860c179a4021b448963675ea26bf (DEFAULT_TABLE table=test-table [id=c42b886d4c004a3f94f50e23f2062009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:22.620939 4873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.615689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41240 (local address 127.2.55.130:36265)
0811 16:47:22.616401 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:22.616406 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:22.616415 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:22.616455 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:22.616457 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:22.616472 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:22.616575 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:22.616717 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.617925 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.619357 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.620129 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.620200 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.620251 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:22.620692 (+ 441us) server_negotiation.cc:299] Negotiation successful
0811 16:47:22.620743 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":104,"threads_started":1}
I20260811 16:47:22.620986 4304 tablet_service.cc:1467] Processing CreateTablet for tablet 37b5860c179a4021b448963675ea26bf (DEFAULT_TABLE table=test-table [id=c42b886d4c004a3f94f50e23f2062009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:22.621228 4734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37b5860c179a4021b448963675ea26bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:22.621309 4304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37b5860c179a4021b448963675ea26bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:22.621553 4514 tablet_service.cc:1467] Processing CreateTablet for tablet 37b5860c179a4021b448963675ea26bf (DEFAULT_TABLE table=test-table [id=c42b886d4c004a3f94f50e23f2062009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:22.621883 4514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37b5860c179a4021b448963675ea26bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:22.624665 4876 tablet_bootstrap.cc:492] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e: Bootstrap starting.
I20260811 16:47:22.625085 4877 tablet_bootstrap.cc:492] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808: Bootstrap starting.
I20260811 16:47:22.625234 4878 tablet_bootstrap.cc:492] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5: Bootstrap starting.
I20260811 16:47:22.625792 4878 tablet_bootstrap.cc:654] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:22.625909 4877 tablet_bootstrap.cc:654] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:22.625947 4876 tablet_bootstrap.cc:654] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:22.626158 4878 log.cc:824] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:22.626289 4877 log.cc:824] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:22.626302 4876 log.cc:824] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:22.627059 4877 tablet_bootstrap.cc:492] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808: No bootstrap required, opened a new log
I20260811 16:47:22.627059 4878 tablet_bootstrap.cc:492] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5: No bootstrap required, opened a new log
I20260811 16:47:22.627138 4878 ts_tablet_manager.cc:1397] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:47:22.627138 4877 ts_tablet_manager.cc:1397] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:47:22.627216 4876 tablet_bootstrap.cc:492] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e: No bootstrap required, opened a new log
I20260811 16:47:22.627291 4876 ts_tablet_manager.cc:1397] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 16:47:22.628809 4876 raft_consensus.cc:348] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } }
I20260811 16:47:22.629019 4876 raft_consensus.cc:374] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:22.629066 4876 raft_consensus.cc:729] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afbd696a74d44bc1b6fe45c02bdd4d9e, State: Initialized, Role: FOLLOWER
I20260811 16:47:22.629180 4876 consensus_queue.cc:260] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } }
I20260811 16:47:22.629211 4877 raft_consensus.cc:348] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } }
I20260811 16:47:22.629209 4878 raft_consensus.cc:348] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } }
I20260811 16:47:22.629365 4878 raft_consensus.cc:374] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:22.629365 4877 raft_consensus.cc:374] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:22.629401 4877 raft_consensus.cc:729] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b027d8c0b60e4ef682a3067b51c05808, State: Initialized, Role: FOLLOWER
I20260811 16:47:22.629401 4878 raft_consensus.cc:729] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b453360e9341406190458e39c7a6d9b5, State: Initialized, Role: FOLLOWER
I20260811 16:47:22.629474 4876 ts_tablet_manager.cc:1428] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:47:22.629508 4877 consensus_queue.cc:260] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } }
I20260811 16:47:22.629508 4878 consensus_queue.cc:260] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } }
I20260811 16:47:22.629608 4836 heartbeater.cc:503] Master 127.2.55.190:44905 was elected leader, sending a full tablet report...
I20260811 16:47:22.629782 4878 ts_tablet_manager.cc:1428] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:47:22.629783 4877 ts_tablet_manager.cc:1428] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:47:22.629832 4612 heartbeater.cc:503] Master 127.2.55.190:44905 was elected leader, sending a full tablet report...
I20260811 16:47:22.629971 4398 heartbeater.cc:503] Master 127.2.55.190:44905 was elected leader, sending a full tablet report...
W20260811 16:47:22.649670 4616 tablet.cc:2369] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:47:22.733671 4400 tablet.cc:2369] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:47:22.763857 4883 raft_consensus.cc:482] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:22.764008 4883 raft_consensus.cc:504] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } }
I20260811 16:47:22.764389 4883 leader_election.cc:288] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b027d8c0b60e4ef682a3067b51c05808 (127.2.55.130:36265), b453360e9341406190458e39c7a6d9b5 (127.2.55.129:46431)
I20260811 16:47:22.767365 4873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.764710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:39281 (local address 127.2.55.130:36265)
0811 16:47:22.764757 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:22.764759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:22.764966 (+ 207us) server_negotiation.cc:407] Connection header received
0811 16:47:22.765003 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:22.765004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:22.765017 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:22.765074 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:22.765251 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.765710 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.766631 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.767009 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.767067 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.767075 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:22.767247 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 16:47:22.767295 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:47:22.767365 4887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.764650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:36265 (local address 127.2.55.131:39281)
0811 16:47:22.764905 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:22.764918 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:22.764965 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:22.765100 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:22.765101 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:22.765102 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:22.765180 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.765182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.765797 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.765798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.766550 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.766552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.767089 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.767090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.767174 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.767178 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:22.767228 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 16:47:22.767260 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":2,"thread_start_us":157,"threads_started":1}
I20260811 16:47:22.767452 4869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.764673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:42413 (local address 127.2.55.129:46431)
0811 16:47:22.764749 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:22.764752 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:22.764763 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:47:22.764802 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:22.764803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:22.764818 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:22.764901 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:22.765124 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.765661 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.766692 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.767062 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.767143 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.767152 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:22.767333 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 16:47:22.767381 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 16:47:22.767479 4666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.764632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:46431 (local address 127.2.55.131:42413)
0811 16:47:22.764691 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:22.764704 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:22.764749 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:22.764920 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:22.764921 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:22.764923 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:22.765004 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.765005 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.765745 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.765746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.766570 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.766572 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.767151 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.767152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.767245 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.767248 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:47:22.767307 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:47:22.767344 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":47}
I20260811 16:47:22.767876 4544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b5860c179a4021b448963675ea26bf" candidate_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b027d8c0b60e4ef682a3067b51c05808" is_pre_election: true
I20260811 16:47:22.767880 4335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b5860c179a4021b448963675ea26bf" candidate_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b453360e9341406190458e39c7a6d9b5" is_pre_election: true
I20260811 16:47:22.768018 4544 raft_consensus.cc:2454] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afbd696a74d44bc1b6fe45c02bdd4d9e in term 0.
I20260811 16:47:22.768036 4335 raft_consensus.cc:2454] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afbd696a74d44bc1b6fe45c02bdd4d9e in term 0.
I20260811 16:47:22.768265 4654 leader_election.cc:302] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afbd696a74d44bc1b6fe45c02bdd4d9e, b027d8c0b60e4ef682a3067b51c05808; no voters:
I20260811 16:47:22.768390 4883 raft_consensus.cc:2781] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:22.768447 4883 raft_consensus.cc:482] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:22.768471 4883 raft_consensus.cc:3037] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:22.769605 4883 raft_consensus.cc:504] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } }
I20260811 16:47:22.769752 4883 leader_election.cc:288] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [CANDIDATE]: Term 1 election: Requested vote from peers b027d8c0b60e4ef682a3067b51c05808 (127.2.55.130:36265), b453360e9341406190458e39c7a6d9b5 (127.2.55.129:46431)
I20260811 16:47:22.769892 4544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b5860c179a4021b448963675ea26bf" candidate_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b027d8c0b60e4ef682a3067b51c05808"
I20260811 16:47:22.769915 4335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37b5860c179a4021b448963675ea26bf" candidate_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b453360e9341406190458e39c7a6d9b5"
I20260811 16:47:22.769968 4544 raft_consensus.cc:3037] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:22.770013 4335 raft_consensus.cc:3037] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:22.770816 4335 raft_consensus.cc:2454] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afbd696a74d44bc1b6fe45c02bdd4d9e in term 1.
I20260811 16:47:22.770826 4544 raft_consensus.cc:2454] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afbd696a74d44bc1b6fe45c02bdd4d9e in term 1.
I20260811 16:47:22.771066 4657 leader_election.cc:302] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: afbd696a74d44bc1b6fe45c02bdd4d9e, b027d8c0b60e4ef682a3067b51c05808, b453360e9341406190458e39c7a6d9b5; no voters:
I20260811 16:47:22.771209 4883 raft_consensus.cc:2781] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:22.771397 4883 raft_consensus.cc:686] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [term 1 LEADER]: Becoming Leader. State: Replica: afbd696a74d44bc1b6fe45c02bdd4d9e, State: Running, Role: LEADER
I20260811 16:47:22.771500 4883 consensus_queue.cc:237] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } }
I20260811 16:47:22.772413 4095 catalog_manager.cc:5495] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e reported cstate change: term changed from 0 to 1, leader changed from <none> to afbd696a74d44bc1b6fe45c02bdd4d9e (127.2.55.131). New cstate: current_term: 1 leader_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } health_report { overall_health: UNKNOWN } } }
I20260811 16:47:22.804898 4875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.801778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41944 (local address 127.2.55.131:36057)
0811 16:47:22.801829 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:22.801832 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:22.801869 (+ 37us) server_negotiation.cc:407] Connection header received
0811 16:47:22.801973 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:22.801974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:22.801996 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:22.802085 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:22.802358 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.802978 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.803875 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.804071 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.804184 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.804447 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:22.804553 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:22.804623 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:22.804691 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 16:47:22.804716 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:47:22.807040 4335 raft_consensus.cc:1261] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5 [term 1 FOLLOWER]: Refusing update from remote peer afbd696a74d44bc1b6fe45c02bdd4d9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:22.807459 4889 consensus_queue.cc:1035] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:22.808671 4544 raft_consensus.cc:1261] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808 [term 1 FOLLOWER]: Refusing update from remote peer afbd696a74d44bc1b6fe45c02bdd4d9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:22.809008 4883 consensus_queue.cc:1035] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:22.814482 4095 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:22.814628 4095 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:22.815451 4095 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761: Sending DeleteTablet for 3 replicas of tablet 37b5860c179a4021b448963675ea26bf
I20260811 16:47:22.815943 4514 tablet_service.cc:1514] Processing DeleteTablet for tablet 37b5860c179a4021b448963675ea26bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:22 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:41240
I20260811 16:47:22.815953 4734 tablet_service.cc:1514] Processing DeleteTablet for tablet 37b5860c179a4021b448963675ea26bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:22 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:41940
I20260811 16:47:22.816207 4907 tablet_replica.cc:330] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808: stopping tablet replica
I20260811 16:47:22.816184 4304 tablet_service.cc:1514] Processing DeleteTablet for tablet 37b5860c179a4021b448963675ea26bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:22 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:54668
I20260811 16:47:22.816309 4907 raft_consensus.cc:2229] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:22.816447 4907 raft_consensus.cc:2258] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:22.816702 4909 tablet_replica.cc:330] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5: stopping tablet replica
I20260811 16:47:22.816721 4095 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38662:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 16:47:22.816812 4909 raft_consensus.cc:2229] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 16:47:22.816885 4095 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:22.816937 4909 raft_consensus.cc:2258] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:22.817193 4908 tablet_replica.cc:330] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e: stopping tablet replica
I20260811 16:47:22.817291 4908 raft_consensus.cc:2229] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:47:22.817400 4908 raft_consensus.cc:2258] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:22.817762 4909 ts_tablet_manager.cc:1905] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:22.818424 4304 tablet_service.cc:1467] Processing CreateTablet for tablet 0a16d0de61d04750a90e158eb90d238a (DEFAULT_TABLE table=test-table [id=c346047da4f942ad922d176b6d3a3f17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:22.818560 4304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a16d0de61d04750a90e158eb90d238a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:22.818567 4907 ts_tablet_manager.cc:1905] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:22.818642 4734 tablet_service.cc:1467] Processing CreateTablet for tablet 0a16d0de61d04750a90e158eb90d238a (DEFAULT_TABLE table=test-table [id=c346047da4f942ad922d176b6d3a3f17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:22.818774 4734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a16d0de61d04750a90e158eb90d238a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:22.820185 4514 tablet_service.cc:1467] Processing CreateTablet for tablet 0a16d0de61d04750a90e158eb90d238a (DEFAULT_TABLE table=test-table [id=c346047da4f942ad922d176b6d3a3f17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:22.820293 4514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a16d0de61d04750a90e158eb90d238a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:22.820328 4876 tablet_bootstrap.cc:492] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e: Bootstrap starting.
I20260811 16:47:22.820778 4876 tablet_bootstrap.cc:654] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:22.821604 4907 ts_tablet_manager.cc:1918] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:22.821719 4907 log.cc:1196] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/37b5860c179a4021b448963675ea26bf
I20260811 16:47:22.821919 4878 tablet_bootstrap.cc:492] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5: Bootstrap starting.
I20260811 16:47:22.822024 4907 ts_tablet_manager.cc:1939] T 37b5860c179a4021b448963675ea26bf P b027d8c0b60e4ef682a3067b51c05808: Deleting consensus metadata
I20260811 16:47:22.822458 4878 tablet_bootstrap.cc:654] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:22.822880 4876 tablet_bootstrap.cc:492] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e: No bootstrap required, opened a new log
I20260811 16:47:22.822882 4877 tablet_bootstrap.cc:492] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808: Bootstrap starting.
I20260811 16:47:22.822930 4876 ts_tablet_manager.cc:1397] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 16:47:22.823143 4878 tablet_bootstrap.cc:492] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5: No bootstrap required, opened a new log
I20260811 16:47:22.823185 4878 ts_tablet_manager.cc:1397] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:22.823249 4876 raft_consensus.cc:348] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:22.823308 4877 tablet_bootstrap.cc:654] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:22.823323 4876 raft_consensus.cc:374] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:22.823346 4876 raft_consensus.cc:729] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afbd696a74d44bc1b6fe45c02bdd4d9e, State: Initialized, Role: FOLLOWER
I20260811 16:47:22.823330 4878 raft_consensus.cc:348] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:22.823405 4878 raft_consensus.cc:374] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:22.823428 4878 raft_consensus.cc:729] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b453360e9341406190458e39c7a6d9b5, State: Initialized, Role: FOLLOWER
I20260811 16:47:22.823393 4876 consensus_queue.cc:260] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:22.823494 4878 consensus_queue.cc:260] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:22.823562 4876 ts_tablet_manager.cc:1428] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:22.823630 4878 ts_tablet_manager.cc:1428] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:22.823812 4076 catalog_manager.cc:4841] TS b027d8c0b60e4ef682a3067b51c05808 (127.2.55.130:36265): tablet 37b5860c179a4021b448963675ea26bf (table test-table [id=c42b886d4c004a3f94f50e23f2062009]) successfully deleted
W20260811 16:47:22.824208 4837 tablet.cc:2369] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:47:22.825305 4877 tablet_bootstrap.cc:492] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808: No bootstrap required, opened a new log
I20260811 16:47:22.825349 4877 ts_tablet_manager.cc:1397] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:47:22.825465 4877 raft_consensus.cc:348] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:22.825515 4877 raft_consensus.cc:374] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:22.825531 4877 raft_consensus.cc:729] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b027d8c0b60e4ef682a3067b51c05808, State: Initialized, Role: FOLLOWER
I20260811 16:47:22.825587 4877 consensus_queue.cc:260] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:22.825683 4877 ts_tablet_manager.cc:1428] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:22.825685 4908 ts_tablet_manager.cc:1905] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:22.826143 4909 ts_tablet_manager.cc:1918] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:22.826222 4909 log.cc:1196] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/wal/wals/37b5860c179a4021b448963675ea26bf
I20260811 16:47:22.826800 4909 ts_tablet_manager.cc:1939] T 37b5860c179a4021b448963675ea26bf P b453360e9341406190458e39c7a6d9b5: Deleting consensus metadata
I20260811 16:47:22.827165 4078 catalog_manager.cc:4841] TS b453360e9341406190458e39c7a6d9b5 (127.2.55.129:46431): tablet 37b5860c179a4021b448963675ea26bf (table test-table [id=c42b886d4c004a3f94f50e23f2062009]) successfully deleted
I20260811 16:47:22.828047 4908 ts_tablet_manager.cc:1918] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:22.828125 4908 log.cc:1196] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/37b5860c179a4021b448963675ea26bf
I20260811 16:47:22.828373 4908 ts_tablet_manager.cc:1939] T 37b5860c179a4021b448963675ea26bf P afbd696a74d44bc1b6fe45c02bdd4d9e: Deleting consensus metadata
I20260811 16:47:22.828888 4075 catalog_manager.cc:4841] TS afbd696a74d44bc1b6fe45c02bdd4d9e (127.2.55.131:36057): tablet 37b5860c179a4021b448963675ea26bf (table test-table [id=c42b886d4c004a3f94f50e23f2062009]) successfully deleted
I20260811 16:47:22.881975 4884 raft_consensus.cc:482] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:22.882103 4884 raft_consensus.cc:504] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:22.882495 4884 leader_election.cc:288] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b453360e9341406190458e39c7a6d9b5 (127.2.55.129:46431), afbd696a74d44bc1b6fe45c02bdd4d9e (127.2.55.131:36057)
I20260811 16:47:22.886109 4915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.882707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:46431 (local address 127.2.55.130:45629)
0811 16:47:22.882879 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:22.882887 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:22.882952 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:22.883114 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:22.883115 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:22.883117 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:22.883213 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.883215 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.883893 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.883894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.885076 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.885079 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.885723 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.885723 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.885772 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.885775 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:47:22.885942 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 16:47:22.885997 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":80,"threads_started":1}
I20260811 16:47:22.886137 4869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.882819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:45629 (local address 127.2.55.129:46431)
0811 16:47:22.882873 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:22.882875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:22.882980 (+ 105us) server_negotiation.cc:407] Connection header received
0811 16:47:22.883015 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:22.883016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:22.883025 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:22.883083 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:22.883291 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.883774 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.885177 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.885599 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.885643 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.885651 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:22.885956 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 16:47:22.886066 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 16:47:22.886348 4449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.882691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:36057 (local address 127.2.55.130:60637)
0811 16:47:22.882761 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:22.882774 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:22.882819 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:22.883155 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:22.883157 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:22.883159 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:22.883230 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.883232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.884225 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.884226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.885264 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.885266 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.886080 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.886081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.886166 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.886170 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:22.886227 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 16:47:22.886273 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 16:47:22.886621 4335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a16d0de61d04750a90e158eb90d238a" candidate_uuid: "b027d8c0b60e4ef682a3067b51c05808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b453360e9341406190458e39c7a6d9b5" is_pre_election: true
I20260811 16:47:22.886725 4875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.882923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:60637 (local address 127.2.55.131:36057)
0811 16:47:22.882970 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:22.882972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:22.882981 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:22.883014 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:22.883015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:22.883025 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:22.883100 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:22.883312 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.884122 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.885349 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.885941 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.886032 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.886041 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:22.886591 (+ 550us) server_negotiation.cc:299] Negotiation successful
0811 16:47:22.886638 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:47:22.886745 4335 raft_consensus.cc:2454] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b027d8c0b60e4ef682a3067b51c05808 in term 0.
I20260811 16:47:22.886945 4437 leader_election.cc:302] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b027d8c0b60e4ef682a3067b51c05808, b453360e9341406190458e39c7a6d9b5; no voters:
I20260811 16:47:22.887024 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a16d0de61d04750a90e158eb90d238a" candidate_uuid: "b027d8c0b60e4ef682a3067b51c05808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" is_pre_election: true
I20260811 16:47:22.887147 4884 raft_consensus.cc:2781] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:22.887195 4884 raft_consensus.cc:482] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:22.887223 4884 raft_consensus.cc:3037] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:22.887209 4764 raft_consensus.cc:2454] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b027d8c0b60e4ef682a3067b51c05808 in term 0.
I20260811 16:47:22.888487 4884 raft_consensus.cc:504] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:22.888706 4884 leader_election.cc:288] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [CANDIDATE]: Term 1 election: Requested vote from peers b453360e9341406190458e39c7a6d9b5 (127.2.55.129:46431), afbd696a74d44bc1b6fe45c02bdd4d9e (127.2.55.131:36057)
I20260811 16:47:22.888863 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a16d0de61d04750a90e158eb90d238a" candidate_uuid: "b027d8c0b60e4ef682a3067b51c05808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e"
I20260811 16:47:22.888862 4335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a16d0de61d04750a90e158eb90d238a" candidate_uuid: "b027d8c0b60e4ef682a3067b51c05808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b453360e9341406190458e39c7a6d9b5"
I20260811 16:47:22.888935 4335 raft_consensus.cc:3037] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:22.888935 4764 raft_consensus.cc:3037] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:22.889879 4764 raft_consensus.cc:2454] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b027d8c0b60e4ef682a3067b51c05808 in term 1.
I20260811 16:47:22.889890 4335 raft_consensus.cc:2454] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b027d8c0b60e4ef682a3067b51c05808 in term 1.
I20260811 16:47:22.890105 4437 leader_election.cc:302] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b027d8c0b60e4ef682a3067b51c05808, b453360e9341406190458e39c7a6d9b5; no voters:
I20260811 16:47:22.890202 4884 raft_consensus.cc:2781] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:22.890347 4884 raft_consensus.cc:686] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [term 1 LEADER]: Becoming Leader. State: Replica: b027d8c0b60e4ef682a3067b51c05808, State: Running, Role: LEADER
I20260811 16:47:22.890435 4884 consensus_queue.cc:237] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:22.891369 4093 catalog_manager.cc:5495] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 reported cstate change: term changed from 0 to 1, leader changed from <none> to b027d8c0b60e4ef682a3067b51c05808 (127.2.55.130). New cstate: current_term: 1 leader_uuid: "b027d8c0b60e4ef682a3067b51c05808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } health_report { overall_health: UNKNOWN } } }
Aug 11 16:47:22 dist-test-slave-3h5h krb5kdc[4017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466841, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:22.949088 4171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.933719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38670 (local address 127.2.55.190:44905)
0811 16:47:22.933787 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:22.933790 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:22.933891 (+ 101us) server_negotiation.cc:407] Connection header received
0811 16:47:22.933968 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:22.933969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:22.933982 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:22.934040 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:22.934536 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.935302 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.936288 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.936543 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.936590 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.946220 (+ 9630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:22.946222 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:22.946222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:22.946233 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:22.947797 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:22.948240 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:22.948242 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:22.948242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:22.948304 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:22.948497 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:22.948498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:22.948499 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:22.948623 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:22.948704 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:22.948888 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 16:47:22.948980 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:47:22.949164 4925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:22.933618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:44905 (local address 127.0.0.1:38670)
0811 16:47:22.933822 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:22.933832 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:22.933893 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:22.934053 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:22.934054 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:22.934355 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:22.934406 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.934408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.935394 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.935395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.936198 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:22.936201 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:22.936675 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:22.936675 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:22.936777 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:22.937826 (+ 1049us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:22.937833 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:22.946059 (+ 8226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:22.947916 (+ 1857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:22.947928 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:22.947930 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:22.948145 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:22.948370 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:22.948371 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:22.948371 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:22.948430 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:22.948694 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:22.948703 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:22.948751 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 16:47:22.948835 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 16:47:22.949039 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":67,"thread_start_us":117,"threads_started":1}
I20260811 16:47:22.951778 4093 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:38670:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 16:47:22.952108 4093 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:22.953730 4734 tablet_service.cc:1467] Processing CreateTablet for tablet 53662dd8d7944b97b3ead3836a51f62e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5166d31cd4ac465398cf055f2e56ec02]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:47:22.953759 4514 tablet_service.cc:1467] Processing CreateTablet for tablet 53662dd8d7944b97b3ead3836a51f62e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5166d31cd4ac465398cf055f2e56ec02]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:47:22.953764 4304 tablet_service.cc:1467] Processing CreateTablet for tablet 53662dd8d7944b97b3ead3836a51f62e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5166d31cd4ac465398cf055f2e56ec02]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:47:22.953953 4514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53662dd8d7944b97b3ead3836a51f62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:22.953953 4304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53662dd8d7944b97b3ead3836a51f62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:22.953953 4734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53662dd8d7944b97b3ead3836a51f62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:22.955245 4876 tablet_bootstrap.cc:492] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e: Bootstrap starting.
I20260811 16:47:22.955472 4878 tablet_bootstrap.cc:492] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5: Bootstrap starting.
I20260811 16:47:22.955593 4876 tablet_bootstrap.cc:654] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:22.956035 4878 tablet_bootstrap.cc:654] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:22.956284 4876 tablet_bootstrap.cc:492] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e: No bootstrap required, opened a new log
I20260811 16:47:22.956329 4876 ts_tablet_manager.cc:1397] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:22.956400 4877 tablet_bootstrap.cc:492] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808: Bootstrap starting.
I20260811 16:47:22.956445 4876 raft_consensus.cc:348] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:22.956512 4876 raft_consensus.cc:374] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:22.956539 4876 raft_consensus.cc:729] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afbd696a74d44bc1b6fe45c02bdd4d9e, State: Initialized, Role: FOLLOWER
I20260811 16:47:22.956591 4876 consensus_queue.cc:260] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:22.956665 4878 tablet_bootstrap.cc:492] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5: No bootstrap required, opened a new log
I20260811 16:47:22.956698 4876 ts_tablet_manager.cc:1428] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:22.956723 4878 ts_tablet_manager.cc:1397] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:22.956789 4877 tablet_bootstrap.cc:654] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:22.956796 4902 tablet_replica.cc:439] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } }
I20260811 16:47:22.956895 4902 tablet_replica.cc:442] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:22.956887 4878 raft_consensus.cc:348] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:22.956966 4878 raft_consensus.cc:374] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:22.956981 4878 raft_consensus.cc:729] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b453360e9341406190458e39c7a6d9b5, State: Initialized, Role: FOLLOWER
I20260811 16:47:22.957044 4878 consensus_queue.cc:260] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:22.957132 4878 ts_tablet_manager.cc:1428] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:22.957206 4886 tablet_replica.cc:439] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } }
I20260811 16:47:22.957289 4886 tablet_replica.cc:442] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:22.957507 4877 tablet_bootstrap.cc:492] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808: No bootstrap required, opened a new log
I20260811 16:47:22.957563 4877 ts_tablet_manager.cc:1397] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:22.957835 4877 raft_consensus.cc:348] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:22.957921 4877 raft_consensus.cc:374] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:22.957947 4877 raft_consensus.cc:729] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b027d8c0b60e4ef682a3067b51c05808, State: Initialized, Role: FOLLOWER
I20260811 16:47:22.958005 4877 consensus_queue.cc:260] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:22.958113 4877 ts_tablet_manager.cc:1428] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 16:47:22.958175 4884 tablet_replica.cc:439] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } }
I20260811 16:47:22.958278 4884 tablet_replica.cc:442] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:23.064549 4884 raft_consensus.cc:482] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:23.064685 4884 raft_consensus.cc:504] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:23.064900 4884 leader_election.cc:288] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b453360e9341406190458e39c7a6d9b5 (127.2.55.129:46431), afbd696a74d44bc1b6fe45c02bdd4d9e (127.2.55.131:36057)
I20260811 16:47:23.065241 4335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53662dd8d7944b97b3ead3836a51f62e" candidate_uuid: "b027d8c0b60e4ef682a3067b51c05808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b453360e9341406190458e39c7a6d9b5" is_pre_election: true
I20260811 16:47:23.065212 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53662dd8d7944b97b3ead3836a51f62e" candidate_uuid: "b027d8c0b60e4ef682a3067b51c05808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" is_pre_election: true
I20260811 16:47:23.065336 4335 raft_consensus.cc:2454] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b027d8c0b60e4ef682a3067b51c05808 in term 0.
I20260811 16:47:23.065336 4764 raft_consensus.cc:2454] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b027d8c0b60e4ef682a3067b51c05808 in term 0.
I20260811 16:47:23.065522 4437 leader_election.cc:302] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b027d8c0b60e4ef682a3067b51c05808, b453360e9341406190458e39c7a6d9b5; no voters:
I20260811 16:47:23.065653 4884 raft_consensus.cc:2781] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:23.065728 4884 raft_consensus.cc:482] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:23.065764 4884 raft_consensus.cc:3037] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:23.066648 4884 raft_consensus.cc:504] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:23.066807 4884 leader_election.cc:288] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [CANDIDATE]: Term 1 election: Requested vote from peers b453360e9341406190458e39c7a6d9b5 (127.2.55.129:46431), afbd696a74d44bc1b6fe45c02bdd4d9e (127.2.55.131:36057)
I20260811 16:47:23.067003 4335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53662dd8d7944b97b3ead3836a51f62e" candidate_uuid: "b027d8c0b60e4ef682a3067b51c05808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b453360e9341406190458e39c7a6d9b5"
I20260811 16:47:23.067004 4764 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53662dd8d7944b97b3ead3836a51f62e" candidate_uuid: "b027d8c0b60e4ef682a3067b51c05808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e"
I20260811 16:47:23.067091 4335 raft_consensus.cc:3037] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:23.067104 4764 raft_consensus.cc:3037] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:23.067967 4335 raft_consensus.cc:2454] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b027d8c0b60e4ef682a3067b51c05808 in term 1.
I20260811 16:47:23.067967 4764 raft_consensus.cc:2454] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b027d8c0b60e4ef682a3067b51c05808 in term 1.
I20260811 16:47:23.068181 4434 leader_election.cc:302] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afbd696a74d44bc1b6fe45c02bdd4d9e, b027d8c0b60e4ef682a3067b51c05808; no voters:
I20260811 16:47:23.068328 4884 raft_consensus.cc:2781] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:23.068403 4884 raft_consensus.cc:686] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [term 1 LEADER]: Becoming Leader. State: Replica: b027d8c0b60e4ef682a3067b51c05808, State: Running, Role: LEADER
I20260811 16:47:23.068459 4884 consensus_queue.cc:237] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } }
I20260811 16:47:23.068763 4916 tablet_replica.cc:439] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808: TxnStatusTablet state changed. Reason: New leader b027d8c0b60e4ef682a3067b51c05808. Latest consensus state: current_term: 1 leader_uuid: "b027d8c0b60e4ef682a3067b51c05808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } }
I20260811 16:47:23.068874 4916 tablet_replica.cc:442] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:47:23.069114 4936 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 16:47:23.069253 4936 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 16:47:23.069162 4095 catalog_manager.cc:5495] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 reported cstate change: term changed from 0 to 1, leader changed from <none> to b027d8c0b60e4ef682a3067b51c05808 (127.2.55.130). New cstate: current_term: 1 leader_uuid: "b027d8c0b60e4ef682a3067b51c05808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } health_report { overall_health: UNKNOWN } } }
I20260811 16:47:23.075930 4925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:23.072871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:36265 (local address 127.0.0.1:41244)
0811 16:47:23.072957 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:23.072967 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:23.073011 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:23.073187 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:23.073188 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:23.073189 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:47:23.073235 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:23.073236 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:23.074265 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:23.074266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:23.074920 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:23.074922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:23.075435 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:23.075436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:23.075482 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:23.075497 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:47:23.075796 (+ 299us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:47:23.075802 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:47:23.075828 (+ 26us) client_negotiation.cc:240] Negotiation successful
0811 16:47:23.075868 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 16:47:23.075948 4873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:23.072912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41244 (local address 127.2.55.130:36265)
0811 16:47:23.072963 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:23.072966 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:23.073001 (+ 35us) server_negotiation.cc:407] Connection header received
0811 16:47:23.073072 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:23.073073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:23.073094 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:23.073182 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:23.073285 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:23.074177 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:23.075005 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:23.075353 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:23.075439 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:23.075597 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:23.075728 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:23.075813 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:23.075843 (+ 30us) server_negotiation.cc:299] Negotiation successful
0811 16:47:23.075870 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:47:23.077232 4335 raft_consensus.cc:1261] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5 [term 1 FOLLOWER]: Refusing update from remote peer b027d8c0b60e4ef682a3067b51c05808: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:23.077293 4764 raft_consensus.cc:1261] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e [term 1 FOLLOWER]: Refusing update from remote peer b027d8c0b60e4ef682a3067b51c05808: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:23.077530 4916 consensus_queue.cc:1035] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:23.077663 4884 consensus_queue.cc:1035] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:23.078430 4902 tablet_replica.cc:439] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e: TxnStatusTablet state changed. Reason: New leader b027d8c0b60e4ef682a3067b51c05808. Latest consensus state: current_term: 1 leader_uuid: "b027d8c0b60e4ef682a3067b51c05808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } }
I20260811 16:47:23.078531 4902 tablet_replica.cc:442] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:23.078908 4886 tablet_replica.cc:439] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5: TxnStatusTablet state changed. Reason: New leader b027d8c0b60e4ef682a3067b51c05808. Latest consensus state: current_term: 1 leader_uuid: "b027d8c0b60e4ef682a3067b51c05808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } }
I20260811 16:47:23.079005 4886 tablet_replica.cc:442] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:23.079720 4916 tablet_replica.cc:439] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b027d8c0b60e4ef682a3067b51c05808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } }
I20260811 16:47:23.079815 4916 tablet_replica.cc:442] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:47:23.079958 4899 mvcc.cc:205] Tried to move back new op lower bound from 7317368189242179584 to 7317368189208895488. Current Snapshot: MvccSnapshot[applied={T|T < 7317368189242179584 or (T in {7317368189242179584})}]
I20260811 16:47:23.080387 4893 mvcc.cc:205] Tried to move back new op lower bound from 7317368189242179584 to 7317368189208895488. Current Snapshot: MvccSnapshot[applied={T|T < 7317368189242179584}]
I20260811 16:47:23.080502 4902 tablet_replica.cc:439] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b027d8c0b60e4ef682a3067b51c05808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } }
I20260811 16:47:23.080663 4902 tablet_replica.cc:442] T 53662dd8d7944b97b3ead3836a51f62e P afbd696a74d44bc1b6fe45c02bdd4d9e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:23.084688 4873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:23.082060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41250 (local address 127.2.55.130:36265)
0811 16:47:23.082120 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:23.082123 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:23.082132 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:23.082157 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:23.082158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:23.082170 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:23.082244 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:23.082352 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:23.083140 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:23.083916 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:23.084253 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:23.084331 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:23.084440 (+ 109us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:23.084480 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:23.084542 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:23.084581 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 16:47:23.084610 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:47:23.089581 4884 tablet_replica.cc:439] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b027d8c0b60e4ef682a3067b51c05808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } }
I20260811 16:47:23.089701 4884 tablet_replica.cc:442] T 53662dd8d7944b97b3ead3836a51f62e P b027d8c0b60e4ef682a3067b51c05808: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:47:23.090235 4873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:23.087414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:41485 (local address 127.2.55.130:36265)
0811 16:47:23.087466 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:23.087469 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:23.087845 (+ 376us) server_negotiation.cc:407] Connection header received
0811 16:47:23.087864 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:23.087865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:23.087873 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:23.087935 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:23.088067 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:23.088501 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:23.089531 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:23.089744 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:23.089803 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:23.089990 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:23.090021 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:23.090077 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:23.090133 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 16:47:23.090150 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:47:23.090260 4945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:23.087363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:36265 (local address 127.2.55.130:41485)
0811 16:47:23.087526 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:23.087537 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:23.087623 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:23.087938 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:23.087939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:23.087940 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:47:23.087998 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:23.087999 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:23.088576 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:23.088577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:23.089460 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:23.089463 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:23.089860 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:23.089861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:23.089899 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:23.089912 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:47:23.090078 (+ 166us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:47:23.090080 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:47:23.090130 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 16:47:23.090168 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":91,"threads_started":1}
I20260811 16:47:23.090426 4894 mvcc.cc:205] Tried to move back new op lower bound from 7317368189242179584 to 7317368189208895488. Current Snapshot: MvccSnapshot[applied={T|T < 7317368189242179584}]
I20260811 16:47:23.090529 4886 tablet_replica.cc:439] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b027d8c0b60e4ef682a3067b51c05808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 } } peers { permanent_uuid: "b027d8c0b60e4ef682a3067b51c05808" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 36265 } } peers { permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 } } }
I20260811 16:47:23.090634 4886 tablet_replica.cc:442] T 53662dd8d7944b97b3ead3836a51f62e P b453360e9341406190458e39c7a6d9b5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:23.092790 4335 raft_consensus.cc:1261] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5 [term 1 FOLLOWER]: Refusing update from remote peer b027d8c0b60e4ef682a3067b51c05808: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:23.092855 4764 raft_consensus.cc:1261] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e [term 1 FOLLOWER]: Refusing update from remote peer b027d8c0b60e4ef682a3067b51c05808: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:23.093029 4916 consensus_queue.cc:1035] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b453360e9341406190458e39c7a6d9b5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 46431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:23.093138 4884 consensus_queue.cc:1035] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afbd696a74d44bc1b6fe45c02bdd4d9e" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:23.108783 4095 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:23.108981 4095 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:23.109686 4095 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 414769fa25dd4163b5320b1316364761: Sending DeleteTablet for 3 replicas of tablet 0a16d0de61d04750a90e158eb90d238a
I20260811 16:47:23.110009 4304 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a16d0de61d04750a90e158eb90d238a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:23 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:54668
I20260811 16:47:23.110072 4734 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a16d0de61d04750a90e158eb90d238a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:23 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:41940
I20260811 16:47:23.110133 4909 tablet_replica.cc:330] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5: stopping tablet replica
I20260811 16:47:23.110201 4908 tablet_replica.cc:330] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e: stopping tablet replica
I20260811 16:47:23.110208 4909 raft_consensus.cc:2229] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:23.110247 4909 raft_consensus.cc:2258] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:23.110265 4908 raft_consensus.cc:2229] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:23.110307 4908 raft_consensus.cc:2258] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:23.110688 4908 ts_tablet_manager.cc:1905] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:23.111173 4514 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a16d0de61d04750a90e158eb90d238a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:23 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:41240
I20260811 16:47:23.111171 4909 ts_tablet_manager.cc:1905] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:23.111274 4907 tablet_replica.cc:330] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808: stopping tablet replica
I20260811 16:47:23.111320 4907 raft_consensus.cc:2229] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:47:23.111420 4907 raft_consensus.cc:2258] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:23.111735 4907 ts_tablet_manager.cc:1905] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:23.112886 4909 ts_tablet_manager.cc:1918] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:47:23.112951 4909 log.cc:1196] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-0/wal/wals/0a16d0de61d04750a90e158eb90d238a
I20260811 16:47:23.113190 4909 ts_tablet_manager.cc:1939] T 0a16d0de61d04750a90e158eb90d238a P b453360e9341406190458e39c7a6d9b5: Deleting consensus metadata
I20260811 16:47:23.113754 4078 catalog_manager.cc:4841] TS b453360e9341406190458e39c7a6d9b5 (127.2.55.129:46431): tablet 0a16d0de61d04750a90e158eb90d238a (table test-table [id=c346047da4f942ad922d176b6d3a3f17]) successfully deleted
I20260811 16:47:23.114019 4907 ts_tablet_manager.cc:1918] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:47:23.114070 4907 log.cc:1196] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/0a16d0de61d04750a90e158eb90d238a
I20260811 16:47:23.114229 4907 ts_tablet_manager.cc:1939] T 0a16d0de61d04750a90e158eb90d238a P b027d8c0b60e4ef682a3067b51c05808: Deleting consensus metadata
I20260811 16:47:23.114446 4908 ts_tablet_manager.cc:1918] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:47:23.114506 4908 log.cc:1196] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/0a16d0de61d04750a90e158eb90d238a
I20260811 16:47:23.114667 4076 catalog_manager.cc:4841] TS b027d8c0b60e4ef682a3067b51c05808 (127.2.55.130:36265): tablet 0a16d0de61d04750a90e158eb90d238a (table test-table [id=c346047da4f942ad922d176b6d3a3f17]) successfully deleted
I20260811 16:47:23.114705 4908 ts_tablet_manager.cc:1939] T 0a16d0de61d04750a90e158eb90d238a P afbd696a74d44bc1b6fe45c02bdd4d9e: Deleting consensus metadata
I20260811 16:47:23.114985 4075 catalog_manager.cc:4841] TS afbd696a74d44bc1b6fe45c02bdd4d9e (127.2.55.131:36057): tablet 0a16d0de61d04750a90e158eb90d238a (table test-table [id=c346047da4f942ad922d176b6d3a3f17]) successfully deleted
Aug 11 16:47:23 dist-test-slave-3h5h krb5kdc[4017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466842, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.2.55.129@KRBTEST.COM
I20260811 16:47:23.122200 4869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:23.111158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54682 (local address 127.2.55.129:46431)
0811 16:47:23.111203 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:23.111206 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:23.111787 (+ 581us) server_negotiation.cc:407] Connection header received
0811 16:47:23.111904 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:23.111905 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:23.111919 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:23.111952 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:23.112978 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:23.113871 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:23.115304 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:23.115488 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:23.115544 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:23.119145 (+ 3601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:23.119156 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:23.119157 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:23.119169 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:23.120969 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:23.121340 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:23.121349 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:23.121349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:23.121415 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:23.121614 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:23.121615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:23.121615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:23.121769 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:23.121929 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:23.122012 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 16:47:23.122099 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 16:47:23.122619 4392 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54682
I20260811 16:47:23.129878 4171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:23.123747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38684 (local address 127.2.55.190:44905)
0811 16:47:23.123791 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:23.123793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:23.123803 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:47:23.123868 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:23.123869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:23.123878 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:23.123923 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:23.124607 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:23.125163 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:23.125837 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:23.126046 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:23.126120 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:23.127250 (+ 1130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:23.127251 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:23.127251 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:23.127259 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:23.128698 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:23.129085 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:23.129087 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:23.129087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:23.129146 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:23.129362 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:23.129363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:23.129364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:23.129476 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:23.129582 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:23.129688 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 16:47:23.129775 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 16:47:23.130111 4095 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38684
I20260811 16:47:23.130702 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 4203
I20260811 16:47:23.147864 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 4414
I20260811 16:47:23.162773 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 4628
I20260811 16:47:23.175716 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 4045
2026-08-11T16:47:23Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2769 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:47:23 dist-test-slave-3h5h krb5kdc[4964](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:47:23 dist-test-slave-3h5h krb5kdc[4964](info): set up 2 sockets
Aug 11 16:47:23 dist-test-slave-3h5h krb5kdc[4964](info): commencing operation
krb5kdc: starting...
W20260811 16:47:24.461166 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:47:24 dist-test-slave-3h5h krb5kdc[4964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:47:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:47:24.593230 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:43429
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:38311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:43429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:24.680382 4990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:24.680599 4990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:24.680622 4990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:24.681818 4990 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:24.681859 4990 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 16:47:24.681872 4990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:24.681926 4990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:24.681948 4990 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:24.681972 4990 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:24.683481 4990 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:38311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:43429
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:43429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:24.683727 4990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:24.683969 4990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:24.689200 4999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:24.689177 5003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:24.689206 4997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:24.689456 4990 server_base.cc:1034] running on GCE node
I20260811 16:47:24.689709 4990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:24.689996 4990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:24.691146 4990 hybrid_clock.cc:648] HybridClock initialized: now 1786466844691127 us; error 34 us; skew 500 ppm
Aug 11 16:47:24 dist-test-slave-3h5h krb5kdc[4964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466844, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:24.693773 4990 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:47:24.694176 4990 webserver.cc:460] Webserver started at http://127.2.55.190:46195/ using document root <none> and password file <none>
I20260811 16:47:24.694363 4990 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:24.694404 4990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:24.694495 4990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:24.695523 4990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "8b0e641395b948408e669322f3e3ad00"
format_stamp: "Formatted at 2026-08-11 16:47:24 on dist-test-slave-3h5h"
server_key: "67fd5a91ea83120e3dd9b9f69fe00cf7"
server_key_iv: "81f93b3ec0b3d755ba5a60734b41626d"
server_key_version: "encryptionkey@0"
I20260811 16:47:24.695840 4990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "8b0e641395b948408e669322f3e3ad00"
format_stamp: "Formatted at 2026-08-11 16:47:24 on dist-test-slave-3h5h"
server_key: "67fd5a91ea83120e3dd9b9f69fe00cf7"
server_key_iv: "81f93b3ec0b3d755ba5a60734b41626d"
server_key_version: "encryptionkey@0"
I20260811 16:47:24.697156 4990 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:24.697870 5014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:24.698053 4990 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:47:24.698128 4990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "8b0e641395b948408e669322f3e3ad00"
format_stamp: "Formatted at 2026-08-11 16:47:24 on dist-test-slave-3h5h"
server_key: "67fd5a91ea83120e3dd9b9f69fe00cf7"
server_key_iv: "81f93b3ec0b3d755ba5a60734b41626d"
server_key_version: "encryptionkey@0"
I20260811 16:47:24.698182 4990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:24.711699 4990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:24.713994 4990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:24.714108 4990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:24.719380 4990 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:43429
I20260811 16:47:24.719471 5111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:43429 every 8 connection(s)
I20260811 16:47:24.719738 4990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:24.720467 5112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:24.723160 5112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00: Bootstrap starting.
I20260811 16:47:24.723877 5112 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:24.724205 5112 log.cc:824] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:24.724957 5112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00: No bootstrap required, opened a new log
I20260811 16:47:24.727432 5112 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b0e641395b948408e669322f3e3ad00" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43429 } }
I20260811 16:47:24.727622 5112 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:24.727682 5112 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b0e641395b948408e669322f3e3ad00, State: Initialized, Role: FOLLOWER
I20260811 16:47:24.727865 5112 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b0e641395b948408e669322f3e3ad00" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43429 } }
I20260811 16:47:24.727957 5112 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:24.728008 5112 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:24.728066 5112 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:24.728670 5112 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b0e641395b948408e669322f3e3ad00" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43429 } }
I20260811 16:47:24.728798 5112 leader_election.cc:302] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b0e641395b948408e669322f3e3ad00; no voters:
I20260811 16:47:24.729033 5112 leader_election.cc:288] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:24.729064 5116 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:24.729233 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 4990
I20260811 16:47:24.729336 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:24.729326 5116 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [term 1 LEADER]: Becoming Leader. State: Replica: 8b0e641395b948408e669322f3e3ad00, State: Running, Role: LEADER
I20260811 16:47:24.729408 5116 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b0e641395b948408e669322f3e3ad00" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43429 } }
I20260811 16:47:24.729435 5112 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:24.729517 2270 external_mini_cluster.cc:1428] Setting key 4dd770bbc0a9382417f393dcb5ca26dd
I20260811 16:47:24.729710 5116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b0e641395b948408e669322f3e3ad00. Latest consensus state: current_term: 1 leader_uuid: "8b0e641395b948408e669322f3e3ad00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b0e641395b948408e669322f3e3ad00" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43429 } } }
I20260811 16:47:24.729722 5121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b0e641395b948408e669322f3e3ad00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b0e641395b948408e669322f3e3ad00" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43429 } } }
I20260811 16:47:24.729799 5116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:24.729805 5121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:24.729990 5127 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:24.730580 5127 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:24.732506 5127 catalog_manager.cc:1347] Generated new cluster ID: dd5c826c945543d99e30773c5e551467
I20260811 16:47:24.732573 5127 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:47:24 dist-test-slave-3h5h krb5kdc[4964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:24.743611 5143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:24.730091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46494 (local address 127.2.55.190:43429)
0811 16:47:24.730312 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:24.730323 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:24.731307 (+ 984us) server_negotiation.cc:407] Connection header received
0811 16:47:24.731516 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:24.731524 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:24.731600 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:24.731761 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:24.732698 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:24.734252 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:24.735424 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:24.736119 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:24.736195 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:24.739289 (+ 3094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:24.739293 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:24.739294 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:24.739308 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:24.741483 (+ 2175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:24.741894 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:24.741897 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:24.741897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:24.742001 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:24.742208 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:24.742208 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:24.742209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:24.742571 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:24.742690 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:24.743179 (+ 489us) server_negotiation.cc:299] Negotiation successful
0811 16:47:24.743340 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":120,"thread_start_us":92,"threads_started":1}
I20260811 16:47:24.749111 5127 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:24.749696 5127 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:24.754215 5127 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00: Generated new TSK 0
I20260811 16:47:24.754415 5127 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:47:24.796046 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:43429
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:38311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:24.901877 5165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:24.902132 5165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:24.902158 5165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:24.903414 5165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:24.903455 5165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:24.903496 5165 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 16:47:24.903530 5165 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:47:24.903578 5165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:47:24.905124 5165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:38311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.55.190:43429
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:24.905395 5165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:24.905661 5165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:24.911269 5174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:24.911360 5175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:24.911279 5181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:24.911312 5165 server_base.cc:1034] running on GCE node
I20260811 16:47:24.911881 5165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:24.912165 5165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:24.913317 5165 hybrid_clock.cc:648] HybridClock initialized: now 1786466844913302 us; error 32 us; skew 500 ppm
Aug 11 16:47:24 dist-test-slave-3h5h krb5kdc[4964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466844, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:24.916180 5165 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:47:24.916617 5165 webserver.cc:460] Webserver started at http://127.2.55.129:42393/ using document root <none> and password file <none>
I20260811 16:47:24.916818 5165 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:24.916930 5165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:24.917042 5165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:24.918350 5165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "276e293bb59d42c5b04553ca9813f8a1"
format_stamp: "Formatted at 2026-08-11 16:47:24 on dist-test-slave-3h5h"
server_key: "a338d90b44e422d4284ce53446f9c07d"
server_key_iv: "867464134a09bc2647c25439307d7323"
server_key_version: "encryptionkey@0"
I20260811 16:47:24.918691 5165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "276e293bb59d42c5b04553ca9813f8a1"
format_stamp: "Formatted at 2026-08-11 16:47:24 on dist-test-slave-3h5h"
server_key: "a338d90b44e422d4284ce53446f9c07d"
server_key_iv: "867464134a09bc2647c25439307d7323"
server_key_version: "encryptionkey@0"
I20260811 16:47:24.920228 5165 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:24.921093 5193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:24.921267 5165 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:24.921382 5165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "276e293bb59d42c5b04553ca9813f8a1"
format_stamp: "Formatted at 2026-08-11 16:47:24 on dist-test-slave-3h5h"
server_key: "a338d90b44e422d4284ce53446f9c07d"
server_key_iv: "867464134a09bc2647c25439307d7323"
server_key_version: "encryptionkey@0"
I20260811 16:47:24.921463 5165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:24.945468 5165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:24.947460 5165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:24.947638 5165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:24.948441 5165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:24.948485 5165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:24.948542 5165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:24.948591 5165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:47:24 dist-test-slave-3h5h krb5kdc[4964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466844, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:24.958161 5165 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:43955
I20260811 16:47:24.958302 5368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:43955 every 8 connection(s)
I20260811 16:47:24.958658 5165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:47:24.961155 5143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:24.948636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:33291 (local address 127.2.55.190:43429)
0811 16:47:24.948691 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:24.948694 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:24.949075 (+ 381us) server_negotiation.cc:407] Connection header received
0811 16:47:24.949929 (+ 854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:24.949930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:24.949947 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:24.949988 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:24.951099 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:24.951829 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:24.953620 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:24.953928 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:24.953995 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:24.957697 (+ 3702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:24.957699 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:24.957699 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:24.957707 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:24.959520 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:24.959950 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:24.959951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:24.959952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:24.960023 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:24.960344 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:24.960345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:24.960345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:24.960489 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:24.960545 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:24.960969 (+ 424us) server_negotiation.cc:299] Negotiation successful
0811 16:47:24.961079 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:47:24.961232 5208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:24.948641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:43429 (local address 127.2.55.129:33291)
0811 16:47:24.948912 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:24.948964 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:24.949797 (+ 833us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:24.950092 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:24.950098 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:24.950609 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:24.950963 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:24.950971 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:24.951952 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:24.951954 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:24.953446 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:24.953449 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:24.954068 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:24.954070 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:24.954569 (+ 499us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:24.955238 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:24.955251 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:24.957581 (+ 2330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:24.959607 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:24.959614 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:24.959616 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:24.959858 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:24.960122 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:24.960123 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:24.960123 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:24.960265 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:24.960557 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:24.960564 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:24.960693 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 16:47:24.960785 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 16:47:24.961056 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":146,"threads_started":1}
I20260811 16:47:24.961843 5370 heartbeater.cc:347] Connected to a master server at 127.2.55.190:43429
I20260811 16:47:24.961941 5370 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:24.962141 5370 heartbeater.cc:511] Master 127.2.55.190:43429 requested a full tablet report, sending...
I20260811 16:47:24.962728 5039 ts_manager.cc:194] Registered new tserver with Master: 276e293bb59d42c5b04553ca9813f8a1 (127.2.55.129:43955)
I20260811 16:47:24.963617 5039 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:33291
I20260811 16:47:24.963872 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 5165
I20260811 16:47:24.963975 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:47:24.964169 2270 external_mini_cluster.cc:1428] Setting key 8912f3216ece08fe0266cf1e6cd3ea57
I20260811 16:47:24.969575 5143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:24.963117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:39267 (local address 127.2.55.190:43429)
0811 16:47:24.963169 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:24.963171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:24.963246 (+ 75us) server_negotiation.cc:407] Connection header received
0811 16:47:24.963321 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:24.963322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:24.963333 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:24.963384 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:24.963732 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:24.964372 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:24.965473 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:24.965688 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:24.965772 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:24.966791 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:24.966792 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:24.966793 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:24.966803 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:24.968386 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:24.968734 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:24.968736 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:24.968736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:24.968801 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:24.969039 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:24.969040 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:24.969040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:24.969158 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:24.969228 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:24.969391 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 16:47:24.969478 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:47:24.969588 5382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:24.963007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:43429 (local address 127.2.55.129:39267)
0811 16:47:24.963187 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:24.963200 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:24.963263 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:24.963387 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:24.963388 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:24.963568 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:24.963628 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:24.963630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:24.964646 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:24.964647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:24.965384 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:24.965386 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:24.965774 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:24.965775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:24.965851 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:24.966316 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:24.966321 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:24.966645 (+ 324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:24.968473 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:24.968474 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:24.968475 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:24.968651 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:24.968906 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:24.968907 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:24.968908 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:24.968970 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:24.969233 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:24.969234 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:24.969283 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 16:47:24.969364 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 16:47:24.969478 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":107,"threads_started":1}
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:47:24.996660 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:43429
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:38311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:25.083348 5388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:25.083570 5388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:25.083596 5388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:25.084780 5388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:25.084854 5388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:25.084880 5388 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 16:47:25.084925 5388 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:47:25.084977 5388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:47:25.086515 5388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:38311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.55.190:43429
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:25.086773 5388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:25.087046 5388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:25.092485 5400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:25.092499 5403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:25.092655 5388 server_base.cc:1034] running on GCE node
W20260811 16:47:25.092746 5401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:25.093012 5388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:25.093276 5388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:25.094450 5388 hybrid_clock.cc:648] HybridClock initialized: now 1786466845094430 us; error 40 us; skew 500 ppm
Aug 11 16:47:25 dist-test-slave-3h5h krb5kdc[4964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466845, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:25.097188 5388 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:47:25.097587 5388 webserver.cc:460] Webserver started at http://127.2.55.130:46337/ using document root <none> and password file <none>
I20260811 16:47:25.097781 5388 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:25.097821 5388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:25.097913 5388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:25.098954 5388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "44b167c0813d468f81fbdd37646cd6ba"
format_stamp: "Formatted at 2026-08-11 16:47:25 on dist-test-slave-3h5h"
server_key: "970a1ccccca7d120188d461e2c18bca9"
server_key_iv: "772f9b134fb1d50064d6766b8c3b6f05"
server_key_version: "encryptionkey@0"
I20260811 16:47:25.099277 5388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "44b167c0813d468f81fbdd37646cd6ba"
format_stamp: "Formatted at 2026-08-11 16:47:25 on dist-test-slave-3h5h"
server_key: "970a1ccccca7d120188d461e2c18bca9"
server_key_iv: "772f9b134fb1d50064d6766b8c3b6f05"
server_key_version: "encryptionkey@0"
I20260811 16:47:25.100584 5388 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:47:25.101487 5411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:25.101640 5388 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:25.101742 5388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "44b167c0813d468f81fbdd37646cd6ba"
format_stamp: "Formatted at 2026-08-11 16:47:25 on dist-test-slave-3h5h"
server_key: "970a1ccccca7d120188d461e2c18bca9"
server_key_iv: "772f9b134fb1d50064d6766b8c3b6f05"
server_key_version: "encryptionkey@0"
I20260811 16:47:25.101799 5388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:25.110507 5388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:25.112512 5388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:25.112630 5388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:25.113216 5388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:25.113256 5388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:25.113279 5388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:25.113323 5388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:25.120438 5388 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:33385
I20260811 16:47:25.120527 5591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:33385 every 8 connection(s)
I20260811 16:47:25.120965 5388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:47:25 dist-test-slave-3h5h krb5kdc[4964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466845, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:25.122478 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 5388
I20260811 16:47:25.122603 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:47:25.122834 2270 external_mini_cluster.cc:1428] Setting key bd2036e6e68dfb0a32a76c3406329683
I20260811 16:47:25.125411 5143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.113999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:46851 (local address 127.2.55.190:43429)
0811 16:47:25.114071 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:25.114074 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:25.114283 (+ 209us) server_negotiation.cc:407] Connection header received
0811 16:47:25.114912 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:25.114914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:25.114930 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:25.114997 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:25.115989 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.116889 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.118678 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.119029 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.119116 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.122122 (+ 3006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:25.122124 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:25.122124 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:25.122131 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:25.123680 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:25.124197 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:25.124198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:25.124198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:25.124252 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:25.124583 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:25.124584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:25.124585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:25.124743 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:25.124809 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:25.125154 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 16:47:25.125269 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:47:25.125492 5424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.113939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:43429 (local address 127.2.55.130:46851)
0811 16:47:25.114134 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:25.114182 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:25.114761 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:25.115099 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:25.115104 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:25.115520 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:25.115867 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.115876 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.117025 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.117027 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.118581 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.118584 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.119212 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.119213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.119406 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.120022 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:25.120032 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:25.121980 (+ 1948us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:25.123761 (+ 1781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:25.123770 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:25.123772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:25.124122 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:25.124316 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:25.124317 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:25.124317 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:25.124486 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:25.124819 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:25.124825 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:25.125014 (+ 189us) client_negotiation.cc:769] Sending connection context
0811 16:47:25.125104 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 16:47:25.125311 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":121,"threads_started":1}
I20260811 16:47:25.127090 5592 heartbeater.cc:347] Connected to a master server at 127.2.55.190:43429
I20260811 16:47:25.127174 5592 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:25.127351 5592 heartbeater.cc:511] Master 127.2.55.190:43429 requested a full tablet report, sending...
I20260811 16:47:25.127688 5042 ts_manager.cc:194] Registered new tserver with Master: 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385)
I20260811 16:47:25.128173 5042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:46851
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
I20260811 16:47:25.133141 5143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.127265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:44437 (local address 127.2.55.190:43429)
0811 16:47:25.127310 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:25.127312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:25.127388 (+ 76us) server_negotiation.cc:407] Connection header received
0811 16:47:25.127495 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:25.127496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:25.127506 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:25.127562 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:25.127962 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.128526 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.129342 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.129528 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.129598 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.130547 (+ 949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:25.130548 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:25.130548 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:25.130555 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:25.131951 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:25.132319 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:25.132321 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:25.132321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:25.132379 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:25.132571 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:25.132572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:25.132573 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:25.132726 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:25.132801 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:25.132985 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 16:47:25.133055 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:47:25.133153 5601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.127192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:43429 (local address 127.2.55.130:44437)
0811 16:47:25.127328 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:25.127338 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:25.127433 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:25.127569 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:25.127570 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:25.127775 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:25.127852 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.127855 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.128629 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.128630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.129247 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.129250 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.129598 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.129599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.129672 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.130130 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:25.130135 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:25.130441 (+ 306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:25.132051 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:25.132052 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:25.132053 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:25.132235 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:25.132443 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:25.132444 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:25.132444 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:25.132505 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:25.132804 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:25.132806 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:25.132884 (+ 78us) client_negotiation.cc:769] Sending connection context
0811 16:47:25.132946 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 16:47:25.133052 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:47:25.151460 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:43429
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:38311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:25.236927 5605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:25.237170 5605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:25.237215 5605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:25.238387 5605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:25.238452 5605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:25.238487 5605 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 16:47:25.238511 5605 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:47:25.238547 5605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:47:25.240613 5605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:38311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.55.190:43429
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:25.240983 5605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:25.241242 5605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:25.246898 5610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:25.246902 5611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:25.246887 5615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:25.247303 5605 server_base.cc:1034] running on GCE node
I20260811 16:47:25.247540 5605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:25.247783 5605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:25.248929 5605 hybrid_clock.cc:648] HybridClock initialized: now 1786466845248908 us; error 30 us; skew 500 ppm
Aug 11 16:47:25 dist-test-slave-3h5h krb5kdc[4964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466845, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:25.251528 5605 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:47:25.252049 5605 webserver.cc:460] Webserver started at http://127.2.55.131:42545/ using document root <none> and password file <none>
I20260811 16:47:25.252307 5605 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:25.252373 5605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:25.252523 5605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:25.253677 5605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "926d0204689947e2b45522e253eeb858"
format_stamp: "Formatted at 2026-08-11 16:47:25 on dist-test-slave-3h5h"
server_key: "2af84548f4de29d5d6488462f6ff73e1"
server_key_iv: "c314b2d93a26cc5cb83e34e7d2be906a"
server_key_version: "encryptionkey@0"
I20260811 16:47:25.254091 5605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "926d0204689947e2b45522e253eeb858"
format_stamp: "Formatted at 2026-08-11 16:47:25 on dist-test-slave-3h5h"
server_key: "2af84548f4de29d5d6488462f6ff73e1"
server_key_iv: "c314b2d93a26cc5cb83e34e7d2be906a"
server_key_version: "encryptionkey@0"
I20260811 16:47:25.255630 5605 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:25.256465 5627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:25.256640 5605 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:25.256739 5605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "926d0204689947e2b45522e253eeb858"
format_stamp: "Formatted at 2026-08-11 16:47:25 on dist-test-slave-3h5h"
server_key: "2af84548f4de29d5d6488462f6ff73e1"
server_key_iv: "c314b2d93a26cc5cb83e34e7d2be906a"
server_key_version: "encryptionkey@0"
I20260811 16:47:25.256816 5605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:25.279469 5605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:25.281477 5605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:25.281652 5605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:25.282287 5605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:25.282357 5605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:25.282402 5605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:25.282423 5605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:47:25 dist-test-slave-3h5h krb5kdc[4964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466845, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:25.289710 5605 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:42599
I20260811 16:47:25.289769 5792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:42599 every 8 connection(s)
I20260811 16:47:25.290160 5605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:47:25.292704 5143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.282711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:40885 (local address 127.2.55.190:43429)
0811 16:47:25.282778 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:25.282781 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:25.283030 (+ 249us) server_negotiation.cc:407] Connection header received
0811 16:47:25.283565 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:25.283566 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:25.283580 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:25.283638 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:25.284325 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.285138 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.286260 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.286465 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.286537 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.289628 (+ 3091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:25.289629 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:25.289629 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:25.289638 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:25.291308 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:25.291735 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:25.291736 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:25.291737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:25.291795 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:25.292024 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:25.292025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:25.292025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:25.292142 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:25.292212 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:25.292419 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 16:47:25.292498 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:47:25.292816 5639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.282711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:43429 (local address 127.2.55.131:40885)
0811 16:47:25.282894 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:25.282935 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:25.283462 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:25.283708 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:25.283714 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:25.284033 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:25.284229 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.284234 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.285234 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.285236 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.286160 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.286163 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.286546 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.286547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.286671 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.287257 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:25.287265 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:25.289515 (+ 2250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:25.291404 (+ 1889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:25.291411 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:25.291413 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:25.291660 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:25.291858 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:25.291859 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:25.291859 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:25.291958 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:25.292204 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:25.292208 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:25.292321 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 16:47:25.292403 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 16:47:25.292555 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":98,"threads_started":1}
I20260811 16:47:25.293356 5793 heartbeater.cc:347] Connected to a master server at 127.2.55.190:43429
I20260811 16:47:25.293443 5793 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:25.293637 5793 heartbeater.cc:511] Master 127.2.55.190:43429 requested a full tablet report, sending...
I20260811 16:47:25.294020 5039 ts_manager.cc:194] Registered new tserver with Master: 926d0204689947e2b45522e253eeb858 (127.2.55.131:42599)
I20260811 16:47:25.294391 5039 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:40885
I20260811 16:47:25.297082 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 5605
I20260811 16:47:25.297194 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:47:25.297456 2270 external_mini_cluster.cc:1428] Setting key 00d26f62def403fffc62ae48dcd559cb
I20260811 16:47:25.298934 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:47:25.302119 5143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.294739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:43333 (local address 127.2.55.190:43429)
0811 16:47:25.294788 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:25.294791 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:25.294937 (+ 146us) server_negotiation.cc:407] Connection header received
0811 16:47:25.294972 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:25.294974 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:25.294986 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:25.295061 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:25.295423 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.295930 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.297226 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.297598 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.297667 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.298819 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:25.298820 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:25.298820 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:25.298827 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:25.300676 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:25.301129 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:25.301130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:25.301131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:25.301208 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:25.301439 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:25.301440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:25.301440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:25.301594 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:25.301672 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:25.301948 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 16:47:25.302037 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:47:25.302215 5804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.294648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:43429 (local address 127.2.55.131:43333)
0811 16:47:25.294852 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:25.294864 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:25.294928 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:25.295068 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:25.295068 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:25.295275 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:25.295343 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.295345 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.296122 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.296123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.297094 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.297097 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.297726 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.297728 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.297798 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.298288 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:25.298293 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:25.298733 (+ 440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:25.300776 (+ 2043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:25.300777 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:25.300777 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:25.301037 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:25.301282 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:25.301283 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:25.301283 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:25.301362 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:25.301709 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:25.301710 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:25.301781 (+ 71us) client_negotiation.cc:769] Sending connection context
0811 16:47:25.301889 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 16:47:25.302059 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":106,"threads_started":1}
Aug 11 16:47:25 dist-test-slave-3h5h krb5kdc[4964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 16:47:25 dist-test-slave-3h5h krb5kdc[4964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:25.327912 5143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.320170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46506 (local address 127.2.55.190:43429)
0811 16:47:25.320250 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:25.320252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:25.320266 (+ 14us) server_negotiation.cc:407] Connection header received
0811 16:47:25.320365 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:25.320366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:25.320378 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:25.320449 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:25.321152 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.321655 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.322391 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.322600 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.322686 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.325194 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:25.325196 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:25.325196 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:25.325204 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:25.326634 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:25.326971 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:25.326972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:25.326972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:25.327154 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:25.327367 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:25.327367 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:25.327368 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:25.327492 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:25.327583 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:25.327704 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 16:47:25.327781 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 16:47:25.329809 5039 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46506:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:47:25.331591 5039 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:25.338714 5826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.334375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:42599 (local address 127.0.0.1:57590)
0811 16:47:25.335284 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:25.335299 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:25.335367 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:25.335579 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:25.335580 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:25.335583 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:25.335621 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.335622 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.336787 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.336788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.337665 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.337668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.338373 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.338374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.338453 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.338467 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:47:25.338574 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 16:47:25.338629 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":889,"mutex_wait_us":3,"thread_start_us":112,"threads_started":1}
I20260811 16:47:25.338729 5827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.334552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57590 (local address 127.2.55.131:42599)
0811 16:47:25.334757 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:25.334762 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:25.335364 (+ 602us) server_negotiation.cc:407] Connection header received
0811 16:47:25.335445 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:25.335448 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:25.335464 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:25.335572 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:25.335701 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.336697 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.337760 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.338282 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.338373 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.338436 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:25.338594 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 16:47:25.338637 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":107,"threads_started":1}
I20260811 16:47:25.339035 5825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.334370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:43955 (local address 127.0.0.1:57392)
0811 16:47:25.334779 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:25.334824 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:25.334896 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:25.335219 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:25.335222 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:25.335225 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:25.335343 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.335346 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.336694 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.336695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.337804 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.337806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.338764 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.338765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.338822 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.338827 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:47:25.338889 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 16:47:25.338935 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"mutex_wait_us":25,"thread_start_us":68,"threads_started":1}
I20260811 16:47:25.339318 5828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.334600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52544 (local address 127.2.55.130:33385)
0811 16:47:25.334980 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:25.334984 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:25.334993 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:25.335073 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:25.335075 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:25.335093 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:25.335174 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:25.335448 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.336262 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.337785 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.338520 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.338602 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.338660 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:25.339081 (+ 421us) server_negotiation.cc:299] Negotiation successful
0811 16:47:25.339224 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":91,"threads_started":1}
I20260811 16:47:25.339396 5829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.334678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57392 (local address 127.2.55.129:43955)
0811 16:47:25.334879 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:25.334884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:25.334895 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:47:25.335100 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:25.335102 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:25.335120 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:25.335196 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:25.335462 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.336586 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.337901 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.338609 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.338680 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.338732 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:25.339227 (+ 495us) server_negotiation.cc:299] Negotiation successful
0811 16:47:25.339276 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":86,"threads_started":1}
I20260811 16:47:25.339567 5824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.334370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:33385 (local address 127.0.0.1:52544)
0811 16:47:25.334856 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:25.334868 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:25.334922 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:25.335220 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:25.335222 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:25.335227 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:25.335343 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.335346 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.336355 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.336356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.337672 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.337675 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.338703 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.338704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.338933 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.338936 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:47:25.338990 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 16:47:25.339025 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"mutex_wait_us":43,"thread_start_us":109,"threads_started":1}
I20260811 16:47:25.339531 5701 tablet_service.cc:1467] Processing CreateTablet for tablet 3552666577c24e25af98344a91a3a03a (DEFAULT_TABLE table=test-table [id=b4608c10b0fb4695a06b953b30e7f167]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:25.339946 5701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3552666577c24e25af98344a91a3a03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:25.340173 5272 tablet_service.cc:1467] Processing CreateTablet for tablet 3552666577c24e25af98344a91a3a03a (DEFAULT_TABLE table=test-table [id=b4608c10b0fb4695a06b953b30e7f167]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:25.340181 5490 tablet_service.cc:1467] Processing CreateTablet for tablet 3552666577c24e25af98344a91a3a03a (DEFAULT_TABLE table=test-table [id=b4608c10b0fb4695a06b953b30e7f167]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:25.340541 5272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3552666577c24e25af98344a91a3a03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:25.340567 5490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3552666577c24e25af98344a91a3a03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:25.342764 5831 tablet_bootstrap.cc:492] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858: Bootstrap starting.
I20260811 16:47:25.343621 5831 tablet_bootstrap.cc:654] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:25.343855 5831 log.cc:824] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:25.344576 5835 tablet_bootstrap.cc:492] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba: Bootstrap starting.
I20260811 16:47:25.345094 5834 tablet_bootstrap.cc:492] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1: Bootstrap starting.
I20260811 16:47:25.345299 5835 tablet_bootstrap.cc:654] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:25.345346 5831 tablet_bootstrap.cc:492] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858: No bootstrap required, opened a new log
I20260811 16:47:25.345567 5831 ts_tablet_manager.cc:1397] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:47:25.345669 5835 log.cc:824] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:25.345881 5834 tablet_bootstrap.cc:654] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:25.346225 5834 log.cc:824] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:25.346488 5835 tablet_bootstrap.cc:492] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba: No bootstrap required, opened a new log
I20260811 16:47:25.346581 5835 ts_tablet_manager.cc:1397] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 16:47:25.347038 5834 tablet_bootstrap.cc:492] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1: No bootstrap required, opened a new log
I20260811 16:47:25.347113 5834 ts_tablet_manager.cc:1397] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:47:25.347553 5831 raft_consensus.cc:348] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } }
I20260811 16:47:25.347707 5831 raft_consensus.cc:374] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:25.347754 5831 raft_consensus.cc:729] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926d0204689947e2b45522e253eeb858, State: Initialized, Role: FOLLOWER
I20260811 16:47:25.347877 5831 consensus_queue.cc:260] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } }
I20260811 16:47:25.348189 5831 ts_tablet_manager.cc:1428] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:47:25.348222 5793 heartbeater.cc:503] Master 127.2.55.190:43429 was elected leader, sending a full tablet report...
I20260811 16:47:25.349149 5834 raft_consensus.cc:348] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } }
I20260811 16:47:25.349291 5834 raft_consensus.cc:374] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:25.349054 5835 raft_consensus.cc:348] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } }
I20260811 16:47:25.349354 5835 raft_consensus.cc:374] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:25.349351 5834 raft_consensus.cc:729] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 276e293bb59d42c5b04553ca9813f8a1, State: Initialized, Role: FOLLOWER
I20260811 16:47:25.349390 5835 raft_consensus.cc:729] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44b167c0813d468f81fbdd37646cd6ba, State: Initialized, Role: FOLLOWER
I20260811 16:47:25.349480 5834 consensus_queue.cc:260] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } }
I20260811 16:47:25.349534 5835 consensus_queue.cc:260] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } }
I20260811 16:47:25.349767 5834 ts_tablet_manager.cc:1428] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:47:25.349767 5835 ts_tablet_manager.cc:1428] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 16:47:25.349933 5592 heartbeater.cc:503] Master 127.2.55.190:43429 was elected leader, sending a full tablet report...
I20260811 16:47:25.349922 5370 heartbeater.cc:503] Master 127.2.55.190:43429 was elected leader, sending a full tablet report...
W20260811 16:47:25.371578 5593 tablet.cc:2369] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:47:25.430972 5840 raft_consensus.cc:482] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:25.431202 5840 raft_consensus.cc:504] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } }
I20260811 16:47:25.431686 5840 leader_election.cc:288] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 926d0204689947e2b45522e253eeb858 (127.2.55.131:42599), 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385)
I20260811 16:47:25.432443 5839 raft_consensus.cc:482] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:25.432591 5839 raft_consensus.cc:504] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } }
I20260811 16:47:25.432930 5839 leader_election.cc:288] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 276e293bb59d42c5b04553ca9813f8a1 (127.2.55.129:43955), 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385)
I20260811 16:47:25.435616 5208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.431892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:42599 (local address 127.2.55.129:58673)
0811 16:47:25.431939 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:25.431963 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:25.432015 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:25.432198 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:25.432199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:25.432201 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:25.432276 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.432279 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.433340 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.433340 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.434567 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.434570 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.435360 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.435361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.435438 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.435442 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:25.435499 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 16:47:25.435538 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23,"mutex_wait_us":52}
I20260811 16:47:25.435858 5827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.432010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:58673 (local address 127.2.55.131:42599)
0811 16:47:25.432067 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:25.432068 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:25.432077 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:25.432104 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:25.432105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:25.432114 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:25.432190 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:25.432397 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.433250 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.434664 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.435248 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.435319 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.435328 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:25.435767 (+ 439us) server_negotiation.cc:299] Negotiation successful
0811 16:47:25.435802 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:47:25.436117 5728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3552666577c24e25af98344a91a3a03a" candidate_uuid: "276e293bb59d42c5b04553ca9813f8a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926d0204689947e2b45522e253eeb858" is_pre_election: true
I20260811 16:47:25.436218 5728 raft_consensus.cc:2454] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 276e293bb59d42c5b04553ca9813f8a1 in term 0.
I20260811 16:47:25.436405 5200 leader_election.cc:302] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 276e293bb59d42c5b04553ca9813f8a1, 926d0204689947e2b45522e253eeb858; no voters:
I20260811 16:47:25.436558 5840 raft_consensus.cc:2781] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:25.436609 5840 raft_consensus.cc:482] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:25.436637 5840 raft_consensus.cc:3037] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:25.436723 5828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.431978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:54447 (local address 127.2.55.130:33385)
0811 16:47:25.432040 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:25.432042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:25.432297 (+ 255us) server_negotiation.cc:407] Connection header received
0811 16:47:25.432371 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:25.432372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:25.432387 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:25.432440 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:25.432673 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.433389 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.435753 (+ 2364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.436289 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.436337 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.436344 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:25.436608 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 16:47:25.436648 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":30}
I20260811 16:47:25.436726 5639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.433078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:43955 (local address 127.2.55.131:59717)
0811 16:47:25.433138 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:25.433148 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:25.433186 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:25.433350 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:25.433351 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:25.433353 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:25.433402 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.433403 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.434183 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.434184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.435370 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.435374 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.436481 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.436482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.436560 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.436564 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:25.436620 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 16:47:25.436663 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":26}
I20260811 16:47:25.437017 5847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.433650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:35049 (local address 127.2.55.130:33385)
0811 16:47:25.433883 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:25.433885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:25.433894 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:25.433917 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:25.433918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:25.433928 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:25.434025 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:25.434213 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.434708 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.436000 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.436571 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.436644 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.436653 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:25.436882 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 16:47:25.436918 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":111,"threads_started":1}
I20260811 16:47:25.437065 5845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.431896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:33385 (local address 127.2.55.129:54447)
0811 16:47:25.432218 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:25.432229 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:25.432310 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:25.432459 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:25.432460 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:25.432462 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:25.432559 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.432561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.433517 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.433518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.435654 (+ 2136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.435655 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.436427 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.436429 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.436509 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.436513 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:25.436874 (+ 361us) client_negotiation.cc:240] Negotiation successful
0811 16:47:25.436929 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":180,"thread_start_us":94,"threads_started":1}
I20260811 16:47:25.437202 5846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.433429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:33385 (local address 127.2.55.131:35049)
0811 16:47:25.433738 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:25.433749 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:25.433797 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:25.434035 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:25.434036 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:25.434038 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:25.434126 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.434127 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.434797 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.434797 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.435888 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.435891 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.436688 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.436689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.436773 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.436777 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:25.436827 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 16:47:25.437126 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":2,"thread_start_us":121,"threads_started":1}
I20260811 16:47:25.437569 5525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3552666577c24e25af98344a91a3a03a" candidate_uuid: "276e293bb59d42c5b04553ca9813f8a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b167c0813d468f81fbdd37646cd6ba" is_pre_election: true
I20260811 16:47:25.437707 5525 raft_consensus.cc:2454] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 276e293bb59d42c5b04553ca9813f8a1 in term 0.
I20260811 16:47:25.437723 5522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3552666577c24e25af98344a91a3a03a" candidate_uuid: "926d0204689947e2b45522e253eeb858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b167c0813d468f81fbdd37646cd6ba" is_pre_election: true
I20260811 16:47:25.437799 5829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.433140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:59717 (local address 127.2.55.129:43955)
0811 16:47:25.433176 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:25.433178 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:25.433186 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:47:25.433241 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:25.433242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:25.433250 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:25.433308 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:25.433470 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.434097 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.435477 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.435976 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.436043 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.436050 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:25.437699 (+ 1649us) server_negotiation.cc:299] Negotiation successful
0811 16:47:25.437745 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:47:25.437811 5522 raft_consensus.cc:2454] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 926d0204689947e2b45522e253eeb858 in term 0.
I20260811 16:47:25.438028 5631 leader_election.cc:302] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44b167c0813d468f81fbdd37646cd6ba, 926d0204689947e2b45522e253eeb858; no voters:
I20260811 16:47:25.438066 5840 raft_consensus.cc:504] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } }
I20260811 16:47:25.438192 5840 leader_election.cc:288] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [CANDIDATE]: Term 1 election: Requested vote from peers 926d0204689947e2b45522e253eeb858 (127.2.55.131:42599), 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385)
I20260811 16:47:25.438194 5839 raft_consensus.cc:2781] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:25.438254 5839 raft_consensus.cc:482] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:25.438277 5839 raft_consensus.cc:3037] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:25.438259 5294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3552666577c24e25af98344a91a3a03a" candidate_uuid: "926d0204689947e2b45522e253eeb858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "276e293bb59d42c5b04553ca9813f8a1" is_pre_election: true
I20260811 16:47:25.438381 5294 raft_consensus.cc:2379] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 926d0204689947e2b45522e253eeb858 in current term 1: Already voted for candidate 276e293bb59d42c5b04553ca9813f8a1 in this term.
I20260811 16:47:25.438428 5728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3552666577c24e25af98344a91a3a03a" candidate_uuid: "276e293bb59d42c5b04553ca9813f8a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926d0204689947e2b45522e253eeb858"
I20260811 16:47:25.438526 5522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3552666577c24e25af98344a91a3a03a" candidate_uuid: "276e293bb59d42c5b04553ca9813f8a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b167c0813d468f81fbdd37646cd6ba"
I20260811 16:47:25.438604 5522 raft_consensus.cc:3037] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:25.439265 5839 raft_consensus.cc:504] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } }
I20260811 16:47:25.439365 5522 raft_consensus.cc:2454] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 276e293bb59d42c5b04553ca9813f8a1 in term 1.
I20260811 16:47:25.439392 5728 raft_consensus.cc:2379] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 276e293bb59d42c5b04553ca9813f8a1 in current term 1: Already voted for candidate 926d0204689947e2b45522e253eeb858 in this term.
I20260811 16:47:25.439409 5839 leader_election.cc:288] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [CANDIDATE]: Term 1 election: Requested vote from peers 276e293bb59d42c5b04553ca9813f8a1 (127.2.55.129:43955), 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385)
I20260811 16:47:25.439627 5522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3552666577c24e25af98344a91a3a03a" candidate_uuid: "926d0204689947e2b45522e253eeb858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b167c0813d468f81fbdd37646cd6ba"
I20260811 16:47:25.439617 5294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3552666577c24e25af98344a91a3a03a" candidate_uuid: "926d0204689947e2b45522e253eeb858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "276e293bb59d42c5b04553ca9813f8a1"
I20260811 16:47:25.439723 5522 raft_consensus.cc:2379] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 926d0204689947e2b45522e253eeb858 in current term 1: Already voted for candidate 276e293bb59d42c5b04553ca9813f8a1 in this term.
I20260811 16:47:25.439687 5197 leader_election.cc:302] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 276e293bb59d42c5b04553ca9813f8a1, 44b167c0813d468f81fbdd37646cd6ba; no voters: 926d0204689947e2b45522e253eeb858
I20260811 16:47:25.439704 5294 raft_consensus.cc:2379] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 926d0204689947e2b45522e253eeb858 in current term 1: Already voted for candidate 276e293bb59d42c5b04553ca9813f8a1 in this term.
I20260811 16:47:25.439800 5840 raft_consensus.cc:2781] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:25.439924 5631 leader_election.cc:302] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 926d0204689947e2b45522e253eeb858; no voters: 276e293bb59d42c5b04553ca9813f8a1, 44b167c0813d468f81fbdd37646cd6ba
I20260811 16:47:25.439985 5840 raft_consensus.cc:686] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [term 1 LEADER]: Becoming Leader. State: Replica: 276e293bb59d42c5b04553ca9813f8a1, State: Running, Role: LEADER
I20260811 16:47:25.440032 5839 raft_consensus.cc:2726] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 16:47:25.440109 5840 consensus_queue.cc:237] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } }
I20260811 16:47:25.440990 5039 catalog_manager.cc:5495] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 276e293bb59d42c5b04553ca9813f8a1 (127.2.55.129). New cstate: current_term: 1 leader_uuid: "276e293bb59d42c5b04553ca9813f8a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } health_report { overall_health: UNKNOWN } } }
W20260811 16:47:25.459506 5373 tablet.cc:2369] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 16:47:25 dist-test-slave-3h5h krb5kdc[4964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466844, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:25.489334 5860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.481672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:43429 (local address 127.0.0.1:46522)
0811 16:47:25.481946 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:25.481957 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:25.482042 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:25.482208 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:25.482209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:25.482563 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:25.482615 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.482618 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.483291 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.483293 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.483813 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.483814 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.484169 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.484170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.484227 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.484770 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:25.484776 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:25.486487 (+ 1711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:25.488139 (+ 1652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:25.488147 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:25.488150 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:25.488374 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:25.488574 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:25.488574 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:25.488575 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:25.488640 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:25.488931 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:25.488949 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:25.489011 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 16:47:25.489106 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 16:47:25.489219 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":1,"thread_start_us":161,"threads_started":1}
I20260811 16:47:25.489342 5143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.481795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46522 (local address 127.2.55.190:43429)
0811 16:47:25.481910 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:25.481914 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:25.482021 (+ 107us) server_negotiation.cc:407] Connection header received
0811 16:47:25.482117 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:25.482118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:25.482134 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:25.482203 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:25.482718 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.483212 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.483894 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.484086 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.484169 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.486599 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:25.486601 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:25.486601 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:25.486609 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:25.488046 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:25.488446 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:25.488446 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:25.488447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:25.488497 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:25.488695 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:25.488696 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:25.488697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:25.488800 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:25.488898 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:25.489127 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 16:47:25.489266 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":76}
I20260811 16:47:25.491430 5039 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:46522:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 16:47:25.491683 5039 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:25.493472 5701 tablet_service.cc:1467] Processing CreateTablet for tablet 5077e8b6b9974baf9130e3a290099bb6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fc68dc30dff948ff81e12ea58b78b40b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:47:25.493501 5272 tablet_service.cc:1467] Processing CreateTablet for tablet 5077e8b6b9974baf9130e3a290099bb6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fc68dc30dff948ff81e12ea58b78b40b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:47:25.493528 5490 tablet_service.cc:1467] Processing CreateTablet for tablet 5077e8b6b9974baf9130e3a290099bb6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fc68dc30dff948ff81e12ea58b78b40b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:47:25.493669 5701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5077e8b6b9974baf9130e3a290099bb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:25.493718 5490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5077e8b6b9974baf9130e3a290099bb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:25.493714 5272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5077e8b6b9974baf9130e3a290099bb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:25.494988 5831 tablet_bootstrap.cc:492] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858: Bootstrap starting.
I20260811 16:47:25.495339 5834 tablet_bootstrap.cc:492] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1: Bootstrap starting.
I20260811 16:47:25.495386 5835 tablet_bootstrap.cc:492] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba: Bootstrap starting.
I20260811 16:47:25.495474 5831 tablet_bootstrap.cc:654] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:25.495770 5835 tablet_bootstrap.cc:654] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:25.495800 5834 tablet_bootstrap.cc:654] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:25.496490 5831 tablet_bootstrap.cc:492] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858: No bootstrap required, opened a new log
I20260811 16:47:25.496548 5831 ts_tablet_manager.cc:1397] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:47:25.496564 5834 tablet_bootstrap.cc:492] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1: No bootstrap required, opened a new log
I20260811 16:47:25.496604 5834 ts_tablet_manager.cc:1397] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:25.496706 5831 raft_consensus.cc:348] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.496788 5831 raft_consensus.cc:374] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:25.496752 5834 raft_consensus.cc:348] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.496815 5834 raft_consensus.cc:374] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:25.496809 5831 raft_consensus.cc:729] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926d0204689947e2b45522e253eeb858, State: Initialized, Role: FOLLOWER
I20260811 16:47:25.496870 5834 raft_consensus.cc:729] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 276e293bb59d42c5b04553ca9813f8a1, State: Initialized, Role: FOLLOWER
I20260811 16:47:25.496897 5831 consensus_queue.cc:260] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.496922 5834 consensus_queue.cc:260] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.497009 5834 ts_tablet_manager.cc:1428] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:25.497009 5831 ts_tablet_manager.cc:1428] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:25.497085 5839 tablet_replica.cc:439] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } }
I20260811 16:47:25.497154 5840 tablet_replica.cc:439] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } }
I20260811 16:47:25.497231 5840 tablet_replica.cc:442] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:25.497219 5839 tablet_replica.cc:442] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:25.497445 5835 tablet_bootstrap.cc:492] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba: No bootstrap required, opened a new log
I20260811 16:47:25.497502 5835 ts_tablet_manager.cc:1397] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 16:47:25.497653 5835 raft_consensus.cc:348] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.497728 5835 raft_consensus.cc:374] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:25.497750 5835 raft_consensus.cc:729] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44b167c0813d468f81fbdd37646cd6ba, State: Initialized, Role: FOLLOWER
I20260811 16:47:25.497795 5835 consensus_queue.cc:260] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.497884 5835 ts_tablet_manager.cc:1428] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:25.497960 5844 tablet_replica.cc:439] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } }
I20260811 16:47:25.498046 5844 tablet_replica.cc:442] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba: This TxnStatusTablet replica's current role is: FOLLOWER
W20260811 16:47:25.540900 5794 tablet.cc:2369] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:47:25.569555 5840 raft_consensus.cc:482] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:25.569674 5840 raft_consensus.cc:504] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.569885 5840 leader_election.cc:288] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385), 926d0204689947e2b45522e253eeb858 (127.2.55.131:42599)
I20260811 16:47:25.570166 5728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5077e8b6b9974baf9130e3a290099bb6" candidate_uuid: "276e293bb59d42c5b04553ca9813f8a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926d0204689947e2b45522e253eeb858" is_pre_election: true
I20260811 16:47:25.570205 5522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5077e8b6b9974baf9130e3a290099bb6" candidate_uuid: "276e293bb59d42c5b04553ca9813f8a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b167c0813d468f81fbdd37646cd6ba" is_pre_election: true
I20260811 16:47:25.570286 5728 raft_consensus.cc:2454] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 276e293bb59d42c5b04553ca9813f8a1 in term 0.
I20260811 16:47:25.570294 5522 raft_consensus.cc:2454] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 276e293bb59d42c5b04553ca9813f8a1 in term 0.
I20260811 16:47:25.570462 5200 leader_election.cc:302] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 276e293bb59d42c5b04553ca9813f8a1, 926d0204689947e2b45522e253eeb858; no voters:
I20260811 16:47:25.570644 5840 raft_consensus.cc:2781] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:25.570693 5840 raft_consensus.cc:482] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:25.570708 5840 raft_consensus.cc:3037] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:25.571364 5840 raft_consensus.cc:504] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.571496 5840 leader_election.cc:288] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [CANDIDATE]: Term 1 election: Requested vote from peers 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385), 926d0204689947e2b45522e253eeb858 (127.2.55.131:42599)
I20260811 16:47:25.571689 5522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5077e8b6b9974baf9130e3a290099bb6" candidate_uuid: "276e293bb59d42c5b04553ca9813f8a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b167c0813d468f81fbdd37646cd6ba"
I20260811 16:47:25.571674 5728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5077e8b6b9974baf9130e3a290099bb6" candidate_uuid: "276e293bb59d42c5b04553ca9813f8a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926d0204689947e2b45522e253eeb858"
I20260811 16:47:25.571762 5728 raft_consensus.cc:3037] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:25.571784 5522 raft_consensus.cc:3037] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:25.572391 5522 raft_consensus.cc:2454] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 276e293bb59d42c5b04553ca9813f8a1 in term 1.
I20260811 16:47:25.572605 5728 raft_consensus.cc:2454] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 276e293bb59d42c5b04553ca9813f8a1 in term 1.
I20260811 16:47:25.572602 5197 leader_election.cc:302] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 276e293bb59d42c5b04553ca9813f8a1, 44b167c0813d468f81fbdd37646cd6ba; no voters:
I20260811 16:47:25.572717 5840 raft_consensus.cc:2781] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:25.572791 5840 raft_consensus.cc:686] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [term 1 LEADER]: Becoming Leader. State: Replica: 276e293bb59d42c5b04553ca9813f8a1, State: Running, Role: LEADER
I20260811 16:47:25.572872 5840 consensus_queue.cc:237] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.573230 5848 tablet_replica.cc:439] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1: TxnStatusTablet state changed. Reason: New leader 276e293bb59d42c5b04553ca9813f8a1. Latest consensus state: current_term: 1 leader_uuid: "276e293bb59d42c5b04553ca9813f8a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } }
I20260811 16:47:25.573318 5848 tablet_replica.cc:442] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:47:25.573587 5869 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 16:47:25.573607 5042 catalog_manager.cc:5495] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 276e293bb59d42c5b04553ca9813f8a1 (127.2.55.129). New cstate: current_term: 1 leader_uuid: "276e293bb59d42c5b04553ca9813f8a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260811 16:47:25.573735 5869 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 16:47:25.594664 5829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.591705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57400 (local address 127.2.55.129:43955)
0811 16:47:25.591757 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:25.591759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:25.591769 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:47:25.591868 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:25.591869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:25.591887 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:25.591947 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:25.592103 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.592571 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.593820 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.594019 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.594084 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.594301 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:25.594397 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:25.594486 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:25.594570 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 16:47:25.594596 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:47:25.594689 5860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.591628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:43955 (local address 127.0.0.1:57400)
0811 16:47:25.591721 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:25.591734 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:25.591780 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:25.591968 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:25.591969 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:25.591971 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:47:25.592028 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.592031 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.592642 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.592643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.593736 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.593739 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.594098 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.594100 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.594187 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.594206 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:47:25.594462 (+ 256us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:47:25.594471 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 16:47:25.594542 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 16:47:25.594591 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 16:47:25.596967 5522 raft_consensus.cc:1261] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Refusing update from remote peer 276e293bb59d42c5b04553ca9813f8a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:25.597294 5728 raft_consensus.cc:1261] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Refusing update from remote peer 276e293bb59d42c5b04553ca9813f8a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:25.597263 5848 consensus_queue.cc:1035] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:25.597676 5848 consensus_queue.cc:1035] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:25.599025 5839 tablet_replica.cc:439] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858: TxnStatusTablet state changed. Reason: New leader 276e293bb59d42c5b04553ca9813f8a1. Latest consensus state: current_term: 1 leader_uuid: "276e293bb59d42c5b04553ca9813f8a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } }
I20260811 16:47:25.599123 5839 tablet_replica.cc:442] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:25.599197 5844 tablet_replica.cc:439] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba: TxnStatusTablet state changed. Reason: New leader 276e293bb59d42c5b04553ca9813f8a1. Latest consensus state: current_term: 1 leader_uuid: "276e293bb59d42c5b04553ca9813f8a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } }
I20260811 16:47:25.599313 5844 tablet_replica.cc:442] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:25.600363 5840 tablet_replica.cc:439] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "276e293bb59d42c5b04553ca9813f8a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } }
I20260811 16:47:25.600468 5840 tablet_replica.cc:442] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:47:25.600535 5840 tablet_replica.cc:439] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "276e293bb59d42c5b04553ca9813f8a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } }
I20260811 16:47:25.600504 5839 tablet_replica.cc:439] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "276e293bb59d42c5b04553ca9813f8a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } }
I20260811 16:47:25.600590 5840 tablet_replica.cc:442] T 5077e8b6b9974baf9130e3a290099bb6 P 276e293bb59d42c5b04553ca9813f8a1: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:47:25.600595 5839 tablet_replica.cc:442] T 5077e8b6b9974baf9130e3a290099bb6 P 926d0204689947e2b45522e253eeb858: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:25.600637 5844 tablet_replica.cc:439] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "276e293bb59d42c5b04553ca9813f8a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } } }
I20260811 16:47:25.600723 5844 tablet_replica.cc:442] T 5077e8b6b9974baf9130e3a290099bb6 P 44b167c0813d468f81fbdd37646cd6ba: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:25.601043 5872 mvcc.cc:205] Tried to move back new op lower bound from 7317368199561760768 to 7317368199466954752. Current Snapshot: MvccSnapshot[applied={T|T < 7317368199561760768}]
I20260811 16:47:25.601136 5875 mvcc.cc:205] Tried to move back new op lower bound from 7317368199561760768 to 7317368199466954752. Current Snapshot: MvccSnapshot[applied={T|T < 7317368199561760768}]
I20260811 16:47:25.601255 5877 mvcc.cc:205] Tried to move back new op lower bound from 7317368199561760768 to 7317368199466954752. Current Snapshot: MvccSnapshot[applied={T|T < 7317368199561760768}]
I20260811 16:47:25.606366 5829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.603674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57408 (local address 127.2.55.129:43955)
0811 16:47:25.603720 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:25.603722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:25.603750 (+ 28us) server_negotiation.cc:407] Connection header received
0811 16:47:25.603844 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:25.603845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:25.603856 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:25.603919 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:25.604044 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.604593 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.605630 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.605836 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.605925 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.606081 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:25.606117 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:25.606198 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:25.606259 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 16:47:25.606282 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:47:25.612186 5829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.609207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:47485 (local address 127.2.55.129:43955)
0811 16:47:25.609253 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:25.609255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:25.609361 (+ 106us) server_negotiation.cc:407] Connection header received
0811 16:47:25.609424 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:25.609425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:25.609433 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:25.609510 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:25.609673 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.610149 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.611411 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.611623 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.611686 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.611907 (+ 221us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:25.611934 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:25.611980 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:25.612064 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 16:47:25.612081 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:47:25.612274 5889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:25.609103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:43955 (local address 127.2.55.129:47485)
0811 16:47:25.609286 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:25.609298 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:25.609360 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:25.609519 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:25.609521 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:25.609534 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:47:25.609594 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.609596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.610221 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.610222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.611313 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:25.611316 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:25.611703 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:25.611704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:25.611778 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:25.611797 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:47:25.611999 (+ 202us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:47:25.612001 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:47:25.612049 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 16:47:25.612094 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":83,"threads_started":1}
I20260811 16:47:25.615062 5728 raft_consensus.cc:1261] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Refusing update from remote peer 276e293bb59d42c5b04553ca9813f8a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:25.615149 5522 raft_consensus.cc:1261] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Refusing update from remote peer 276e293bb59d42c5b04553ca9813f8a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:25.615278 5848 consensus_queue.cc:1035] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:25.615600 5848 consensus_queue.cc:1035] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:25.632431 5039 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46506:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:25.632562 5039 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46506:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:25.633416 5039 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00: Sending DeleteTablet for 3 replicas of tablet 3552666577c24e25af98344a91a3a03a
I20260811 16:47:25.633774 5701 tablet_service.cc:1514] Processing DeleteTablet for tablet 3552666577c24e25af98344a91a3a03a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:25 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:57590
I20260811 16:47:25.633792 5490 tablet_service.cc:1514] Processing DeleteTablet for tablet 3552666577c24e25af98344a91a3a03a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:25 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:52544
I20260811 16:47:25.634039 5901 tablet_replica.cc:330] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858: stopping tablet replica
I20260811 16:47:25.634076 5272 tablet_service.cc:1514] Processing DeleteTablet for tablet 3552666577c24e25af98344a91a3a03a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:25 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:57392
I20260811 16:47:25.634155 5901 raft_consensus.cc:2229] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:25.634212 5901 raft_consensus.cc:2258] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:25.634295 5902 tablet_replica.cc:330] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1: stopping tablet replica
I20260811 16:47:25.634320 5039 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46506:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 16:47:25.634392 5902 raft_consensus.cc:2229] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [term 1 LEADER]: Raft consensus shutting down.
W20260811 16:47:25.634452 5039 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:25.634470 5902 raft_consensus.cc:2258] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:25.634699 5901 ts_tablet_manager.cc:1905] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:25.635069 5902 ts_tablet_manager.cc:1905] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:25.635959 5272 tablet_service.cc:1467] Processing CreateTablet for tablet 24681bfdede44ee8886272644a4c85ef (DEFAULT_TABLE table=test-table [id=8f41b9e9e12e414095b581cb5b15e407]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:25.636161 5272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24681bfdede44ee8886272644a4c85ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:25.636567 5901 ts_tablet_manager.cc:1918] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:47:25.636637 5901 log.cc:1196] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/3552666577c24e25af98344a91a3a03a
I20260811 16:47:25.636897 5902 ts_tablet_manager.cc:1918] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:47:25.636956 5901 ts_tablet_manager.cc:1939] T 3552666577c24e25af98344a91a3a03a P 926d0204689947e2b45522e253eeb858: Deleting consensus metadata
I20260811 16:47:25.636960 5902 log.cc:1196] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/wal/wals/3552666577c24e25af98344a91a3a03a
I20260811 16:47:25.637269 5902 ts_tablet_manager.cc:1939] T 3552666577c24e25af98344a91a3a03a P 276e293bb59d42c5b04553ca9813f8a1: Deleting consensus metadata
I20260811 16:47:25.637462 5834 tablet_bootstrap.cc:492] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1: Bootstrap starting.
I20260811 16:47:25.637493 5701 tablet_service.cc:1467] Processing CreateTablet for tablet 24681bfdede44ee8886272644a4c85ef (DEFAULT_TABLE table=test-table [id=8f41b9e9e12e414095b581cb5b15e407]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:25.637590 5701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24681bfdede44ee8886272644a4c85ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:25.637899 5834 tablet_bootstrap.cc:654] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:25.638473 5831 tablet_bootstrap.cc:492] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858: Bootstrap starting.
I20260811 16:47:25.638577 5834 tablet_bootstrap.cc:492] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1: No bootstrap required, opened a new log
I20260811 16:47:25.638621 5834 ts_tablet_manager.cc:1397] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:25.638603 5022 catalog_manager.cc:4841] TS 926d0204689947e2b45522e253eeb858 (127.2.55.131:42599): tablet 3552666577c24e25af98344a91a3a03a (table test-table [id=b4608c10b0fb4695a06b953b30e7f167]) successfully deleted
I20260811 16:47:25.638759 5834 raft_consensus.cc:348] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.638825 5834 raft_consensus.cc:374] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:25.638850 5834 raft_consensus.cc:729] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 276e293bb59d42c5b04553ca9813f8a1, State: Initialized, Role: FOLLOWER
I20260811 16:47:25.638834 5020 catalog_manager.cc:4841] TS 276e293bb59d42c5b04553ca9813f8a1 (127.2.55.129:43955): tablet 3552666577c24e25af98344a91a3a03a (table test-table [id=b4608c10b0fb4695a06b953b30e7f167]) successfully deleted
I20260811 16:47:25.638870 5831 tablet_bootstrap.cc:654] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:25.638896 5834 consensus_queue.cc:260] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.638988 5834 ts_tablet_manager.cc:1428] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:25.639561 5831 tablet_bootstrap.cc:492] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858: No bootstrap required, opened a new log
I20260811 16:47:25.639547 5490 tablet_service.cc:1467] Processing CreateTablet for tablet 24681bfdede44ee8886272644a4c85ef (DEFAULT_TABLE table=test-table [id=8f41b9e9e12e414095b581cb5b15e407]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:25.639614 5831 ts_tablet_manager.cc:1397] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:25.639667 5490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24681bfdede44ee8886272644a4c85ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:25.639885 5831 raft_consensus.cc:348] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.639966 5831 raft_consensus.cc:374] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:25.639999 5831 raft_consensus.cc:729] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926d0204689947e2b45522e253eeb858, State: Initialized, Role: FOLLOWER
I20260811 16:47:25.640035 5831 consensus_queue.cc:260] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.640146 5831 ts_tablet_manager.cc:1428] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:25.640652 5899 tablet_replica.cc:330] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba: stopping tablet replica
I20260811 16:47:25.640813 5899 raft_consensus.cc:2229] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:25.640908 5899 raft_consensus.cc:2258] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:25.641050 5835 tablet_bootstrap.cc:492] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba: Bootstrap starting.
I20260811 16:47:25.641489 5835 tablet_bootstrap.cc:654] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:25.642056 5835 tablet_bootstrap.cc:492] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba: No bootstrap required, opened a new log
I20260811 16:47:25.642115 5835 ts_tablet_manager.cc:1397] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:25.642261 5835 raft_consensus.cc:348] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.642330 5835 raft_consensus.cc:374] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:25.642357 5835 raft_consensus.cc:729] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44b167c0813d468f81fbdd37646cd6ba, State: Initialized, Role: FOLLOWER
I20260811 16:47:25.642406 5835 consensus_queue.cc:260] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.642503 5835 ts_tablet_manager.cc:1428] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:25.642765 5899 ts_tablet_manager.cc:1905] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:25.644385 5899 ts_tablet_manager.cc:1918] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:47:25.644469 5899 log.cc:1196] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/3552666577c24e25af98344a91a3a03a
I20260811 16:47:25.644735 5899 ts_tablet_manager.cc:1939] T 3552666577c24e25af98344a91a3a03a P 44b167c0813d468f81fbdd37646cd6ba: Deleting consensus metadata
I20260811 16:47:25.645177 5021 catalog_manager.cc:4841] TS 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385): tablet 3552666577c24e25af98344a91a3a03a (table test-table [id=b4608c10b0fb4695a06b953b30e7f167]) successfully deleted
I20260811 16:47:25.932176 5848 raft_consensus.cc:482] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:25.932300 5848 raft_consensus.cc:504] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.932543 5848 leader_election.cc:288] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385), 926d0204689947e2b45522e253eeb858 (127.2.55.131:42599)
I20260811 16:47:25.932801 5522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24681bfdede44ee8886272644a4c85ef" candidate_uuid: "276e293bb59d42c5b04553ca9813f8a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b167c0813d468f81fbdd37646cd6ba" is_pre_election: true
I20260811 16:47:25.932808 5728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24681bfdede44ee8886272644a4c85ef" candidate_uuid: "276e293bb59d42c5b04553ca9813f8a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926d0204689947e2b45522e253eeb858" is_pre_election: true
I20260811 16:47:25.932942 5728 raft_consensus.cc:2454] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 276e293bb59d42c5b04553ca9813f8a1 in term 0.
I20260811 16:47:25.933002 5522 raft_consensus.cc:2454] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 276e293bb59d42c5b04553ca9813f8a1 in term 0.
I20260811 16:47:25.933158 5200 leader_election.cc:302] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 276e293bb59d42c5b04553ca9813f8a1, 926d0204689947e2b45522e253eeb858; no voters:
I20260811 16:47:25.933298 5848 raft_consensus.cc:2781] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:25.933336 5848 raft_consensus.cc:482] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:25.933351 5848 raft_consensus.cc:3037] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:25.934087 5848 raft_consensus.cc:504] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.934239 5848 leader_election.cc:288] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [CANDIDATE]: Term 1 election: Requested vote from peers 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385), 926d0204689947e2b45522e253eeb858 (127.2.55.131:42599)
I20260811 16:47:25.934422 5522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24681bfdede44ee8886272644a4c85ef" candidate_uuid: "276e293bb59d42c5b04553ca9813f8a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b167c0813d468f81fbdd37646cd6ba"
I20260811 16:47:25.934499 5522 raft_consensus.cc:3037] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:25.934465 5728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24681bfdede44ee8886272644a4c85ef" candidate_uuid: "276e293bb59d42c5b04553ca9813f8a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926d0204689947e2b45522e253eeb858"
I20260811 16:47:25.934567 5728 raft_consensus.cc:3037] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:25.935170 5522 raft_consensus.cc:2454] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 276e293bb59d42c5b04553ca9813f8a1 in term 1.
I20260811 16:47:25.935204 5728 raft_consensus.cc:2454] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 276e293bb59d42c5b04553ca9813f8a1 in term 1.
I20260811 16:47:25.935359 5197 leader_election.cc:302] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 276e293bb59d42c5b04553ca9813f8a1, 44b167c0813d468f81fbdd37646cd6ba; no voters:
I20260811 16:47:25.935495 5848 raft_consensus.cc:2781] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:25.935580 5848 raft_consensus.cc:686] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [term 1 LEADER]: Becoming Leader. State: Replica: 276e293bb59d42c5b04553ca9813f8a1, State: Running, Role: LEADER
I20260811 16:47:25.935642 5848 consensus_queue.cc:237] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:25.936401 5039 catalog_manager.cc:5495] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 276e293bb59d42c5b04553ca9813f8a1 (127.2.55.129). New cstate: current_term: 1 leader_uuid: "276e293bb59d42c5b04553ca9813f8a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260811 16:47:25.999128 5728 raft_consensus.cc:1261] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Refusing update from remote peer 276e293bb59d42c5b04553ca9813f8a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:25.999128 5522 raft_consensus.cc:1261] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Refusing update from remote peer 276e293bb59d42c5b04553ca9813f8a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:25.999384 5840 consensus_queue.cc:1035] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:25.999492 5892 consensus_queue.cc:1035] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 16:47:26.004261 5872 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 16:47:27.524544 5038 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46506:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:27.524659 5038 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46506:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:27.525635 5038 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00: Sending DeleteTablet for 3 replicas of tablet 24681bfdede44ee8886272644a4c85ef
I20260811 16:47:27.525918 5701 tablet_service.cc:1514] Processing DeleteTablet for tablet 24681bfdede44ee8886272644a4c85ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:27 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:57590
I20260811 16:47:27.525913 5270 tablet_service.cc:1514] Processing DeleteTablet for tablet 24681bfdede44ee8886272644a4c85ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:27 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:57392
I20260811 16:47:27.525928 5490 tablet_service.cc:1514] Processing DeleteTablet for tablet 24681bfdede44ee8886272644a4c85ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:27 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:52544
I20260811 16:47:27.526234 5940 tablet_replica.cc:330] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1: stopping tablet replica
I20260811 16:47:27.526356 5940 raft_consensus.cc:2229] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:47:27.526234 5943 tablet_replica.cc:330] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858: stopping tablet replica
I20260811 16:47:27.526479 5940 raft_consensus.cc:2258] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:27.526487 5943 raft_consensus.cc:2229] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:27.526530 5943 raft_consensus.cc:2258] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:27.526785 5940 ts_tablet_manager.cc:1905] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:27.528673 5943 ts_tablet_manager.cc:1905] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:27.528909 5940 ts_tablet_manager.cc:1918] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 16:47:27.529067 5940 log.cc:1196] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/wal/wals/24681bfdede44ee8886272644a4c85ef
I20260811 16:47:27.529467 5940 ts_tablet_manager.cc:1939] T 24681bfdede44ee8886272644a4c85ef P 276e293bb59d42c5b04553ca9813f8a1: Deleting consensus metadata
I20260811 16:47:27.529637 5942 tablet_replica.cc:330] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba: stopping tablet replica
I20260811 16:47:27.529708 5942 raft_consensus.cc:2229] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:27.529758 5942 raft_consensus.cc:2258] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:27.529807 5020 catalog_manager.cc:4841] TS 276e293bb59d42c5b04553ca9813f8a1 (127.2.55.129:43955): tablet 24681bfdede44ee8886272644a4c85ef (table test-table [id=8f41b9e9e12e414095b581cb5b15e407]) successfully deleted
I20260811 16:47:27.530052 5942 ts_tablet_manager.cc:1905] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:27.530531 5943 ts_tablet_manager.cc:1918] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 16:47:27.530611 5943 log.cc:1196] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/24681bfdede44ee8886272644a4c85ef
I20260811 16:47:27.530927 5943 ts_tablet_manager.cc:1939] T 24681bfdede44ee8886272644a4c85ef P 926d0204689947e2b45522e253eeb858: Deleting consensus metadata
I20260811 16:47:27.531419 5022 catalog_manager.cc:4841] TS 926d0204689947e2b45522e253eeb858 (127.2.55.131:42599): tablet 24681bfdede44ee8886272644a4c85ef (table test-table [id=8f41b9e9e12e414095b581cb5b15e407]) successfully deleted
I20260811 16:47:27.531944 5942 ts_tablet_manager.cc:1918] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 16:47:27.532017 5942 log.cc:1196] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/24681bfdede44ee8886272644a4c85ef
I20260811 16:47:27.532270 5942 ts_tablet_manager.cc:1939] T 24681bfdede44ee8886272644a4c85ef P 44b167c0813d468f81fbdd37646cd6ba: Deleting consensus metadata
I20260811 16:47:27.532620 5021 catalog_manager.cc:4841] TS 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385): tablet 24681bfdede44ee8886272644a4c85ef (table test-table [id=8f41b9e9e12e414095b581cb5b15e407]) successfully deleted
Aug 11 16:47:27 dist-test-slave-3h5h krb5kdc[4964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466847, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 16:47:27 dist-test-slave-3h5h krb5kdc[4964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466847, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:27.558320 5955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:27.544668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46536 (local address 127.2.55.190:43429)
0811 16:47:27.544824 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:27.544826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:27.544859 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:47:27.544981 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:27.544982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:27.544995 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:27.545077 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:27.545646 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:27.546183 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:27.546922 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:27.547138 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:27.547213 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:27.555544 (+ 8331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:27.555547 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:27.555547 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:27.555560 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:27.557027 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:27.557387 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:27.557388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:27.557389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:27.557454 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:27.557733 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:27.557734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:27.557735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:27.557862 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:27.557966 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:27.558106 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 16:47:27.558202 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
I20260811 16:47:27.559875 5038 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46536:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:47:27.560057 5038 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:27.561635 5270 tablet_service.cc:1467] Processing CreateTablet for tablet c2cb2e1bfaea4e7a8e1cd4d22be20549 (DEFAULT_TABLE table=test-table [id=627919f82d634df39585e97732f2f944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:27.561653 5701 tablet_service.cc:1467] Processing CreateTablet for tablet c2cb2e1bfaea4e7a8e1cd4d22be20549 (DEFAULT_TABLE table=test-table [id=627919f82d634df39585e97732f2f944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:27.561645 5490 tablet_service.cc:1467] Processing CreateTablet for tablet c2cb2e1bfaea4e7a8e1cd4d22be20549 (DEFAULT_TABLE table=test-table [id=627919f82d634df39585e97732f2f944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:27.561798 5701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2cb2e1bfaea4e7a8e1cd4d22be20549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:27.561798 5270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2cb2e1bfaea4e7a8e1cd4d22be20549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:27.561822 5490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2cb2e1bfaea4e7a8e1cd4d22be20549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:27.563081 5959 tablet_bootstrap.cc:492] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba: Bootstrap starting.
I20260811 16:47:27.563323 5963 tablet_bootstrap.cc:492] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858: Bootstrap starting.
I20260811 16:47:27.563470 5959 tablet_bootstrap.cc:654] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:27.563820 5963 tablet_bootstrap.cc:654] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:27.564168 5962 tablet_bootstrap.cc:492] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1: Bootstrap starting.
I20260811 16:47:27.564301 5959 tablet_bootstrap.cc:492] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba: No bootstrap required, opened a new log
I20260811 16:47:27.564411 5959 ts_tablet_manager.cc:1397] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:27.564461 5963 tablet_bootstrap.cc:492] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858: No bootstrap required, opened a new log
I20260811 16:47:27.564522 5963 ts_tablet_manager.cc:1397] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:27.564527 5962 tablet_bootstrap.cc:654] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:27.564636 5959 raft_consensus.cc:348] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:27.564724 5959 raft_consensus.cc:374] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:27.564671 5963 raft_consensus.cc:348] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:27.564747 5959 raft_consensus.cc:729] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44b167c0813d468f81fbdd37646cd6ba, State: Initialized, Role: FOLLOWER
I20260811 16:47:27.564749 5963 raft_consensus.cc:374] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:27.564777 5963 raft_consensus.cc:729] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926d0204689947e2b45522e253eeb858, State: Initialized, Role: FOLLOWER
I20260811 16:47:27.564870 5959 consensus_queue.cc:260] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:27.564880 5963 consensus_queue.cc:260] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:27.565071 5959 ts_tablet_manager.cc:1428] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 16:47:27.565071 5963 ts_tablet_manager.cc:1428] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:27.565194 5962 tablet_bootstrap.cc:492] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1: No bootstrap required, opened a new log
I20260811 16:47:27.565264 5962 ts_tablet_manager.cc:1397] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:27.565387 5962 raft_consensus.cc:348] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:27.565486 5962 raft_consensus.cc:374] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:27.565514 5962 raft_consensus.cc:729] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 276e293bb59d42c5b04553ca9813f8a1, State: Initialized, Role: FOLLOWER
I20260811 16:47:27.565563 5962 consensus_queue.cc:260] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:27.565659 5962 ts_tablet_manager.cc:1428] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:27.690501 5971 raft_consensus.cc:482] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:27.690605 5971 raft_consensus.cc:504] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:27.690824 5971 leader_election.cc:288] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 276e293bb59d42c5b04553ca9813f8a1 (127.2.55.129:43955), 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385)
I20260811 16:47:27.691224 5294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2cb2e1bfaea4e7a8e1cd4d22be20549" candidate_uuid: "926d0204689947e2b45522e253eeb858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "276e293bb59d42c5b04553ca9813f8a1" is_pre_election: true
I20260811 16:47:27.691231 5525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2cb2e1bfaea4e7a8e1cd4d22be20549" candidate_uuid: "926d0204689947e2b45522e253eeb858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b167c0813d468f81fbdd37646cd6ba" is_pre_election: true
I20260811 16:47:27.691354 5294 raft_consensus.cc:2454] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 926d0204689947e2b45522e253eeb858 in term 0.
I20260811 16:47:27.691359 5525 raft_consensus.cc:2454] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 926d0204689947e2b45522e253eeb858 in term 0.
I20260811 16:47:27.691525 5631 leader_election.cc:302] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44b167c0813d468f81fbdd37646cd6ba, 926d0204689947e2b45522e253eeb858; no voters:
I20260811 16:47:27.691663 5971 raft_consensus.cc:2781] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:27.691711 5971 raft_consensus.cc:482] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:27.691733 5971 raft_consensus.cc:3037] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:27.692560 5971 raft_consensus.cc:504] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:27.692766 5971 leader_election.cc:288] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [CANDIDATE]: Term 1 election: Requested vote from peers 276e293bb59d42c5b04553ca9813f8a1 (127.2.55.129:43955), 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385)
I20260811 16:47:27.692902 5294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2cb2e1bfaea4e7a8e1cd4d22be20549" candidate_uuid: "926d0204689947e2b45522e253eeb858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "276e293bb59d42c5b04553ca9813f8a1"
I20260811 16:47:27.692996 5294 raft_consensus.cc:3037] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:27.692962 5525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2cb2e1bfaea4e7a8e1cd4d22be20549" candidate_uuid: "926d0204689947e2b45522e253eeb858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b167c0813d468f81fbdd37646cd6ba"
I20260811 16:47:27.693068 5525 raft_consensus.cc:3037] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:27.693728 5294 raft_consensus.cc:2454] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926d0204689947e2b45522e253eeb858 in term 1.
I20260811 16:47:27.693837 5525 raft_consensus.cc:2454] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 926d0204689947e2b45522e253eeb858 in term 1.
I20260811 16:47:27.693905 5630 leader_election.cc:302] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 276e293bb59d42c5b04553ca9813f8a1, 926d0204689947e2b45522e253eeb858; no voters:
I20260811 16:47:27.693987 5971 raft_consensus.cc:2781] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:27.694166 5971 raft_consensus.cc:686] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [term 1 LEADER]: Becoming Leader. State: Replica: 926d0204689947e2b45522e253eeb858, State: Running, Role: LEADER
I20260811 16:47:27.694293 5971 consensus_queue.cc:237] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:27.695122 5042 catalog_manager.cc:5495] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 reported cstate change: term changed from 0 to 1, leader changed from <none> to 926d0204689947e2b45522e253eeb858 (127.2.55.131). New cstate: current_term: 1 leader_uuid: "926d0204689947e2b45522e253eeb858" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } health_report { overall_health: HEALTHY } } }
I20260811 16:47:27.714583 5977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:27.711725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57592 (local address 127.2.55.131:42599)
0811 16:47:27.712030 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:27.712032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:27.712049 (+ 17us) server_negotiation.cc:407] Connection header received
0811 16:47:27.712087 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:27.712088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:27.712107 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:27.712194 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:27.712343 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:27.712957 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:27.713766 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:27.713976 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:27.714034 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:27.714208 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:27.714328 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:27.714387 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:27.714426 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 16:47:27.714443 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":215,"threads_started":1}
I20260811 16:47:27.719810 5982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:27.717387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:56233 (local address 127.2.55.129:43955)
0811 16:47:27.717545 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:27.717547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:27.717556 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:27.717591 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:27.717592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:27.717603 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:27.717705 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:27.717813 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:27.718284 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:27.719035 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:27.719237 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:27.719313 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:27.719558 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:27.719593 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:27.719650 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:27.719705 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 16:47:27.719728 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":89,"threads_started":1}
I20260811 16:47:27.719887 5981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:27.717313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:43955 (local address 127.2.55.131:56233)
0811 16:47:27.717467 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:27.717478 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:27.717532 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:27.717685 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:27.717686 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:27.717688 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:47:27.717757 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:27.717758 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:27.718364 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:27.718365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:27.718941 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:27.718943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:27.719313 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:27.719314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:27.719446 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:27.719460 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:47:27.719654 (+ 194us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:47:27.719656 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:47:27.719704 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 16:47:27.719749 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":85,"threads_started":1}
I20260811 16:47:27.723934 5525 raft_consensus.cc:1261] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Refusing update from remote peer 926d0204689947e2b45522e253eeb858: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:27.724052 5294 raft_consensus.cc:1261] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1 [term 1 FOLLOWER]: Refusing update from remote peer 926d0204689947e2b45522e253eeb858: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:27.724211 5971 consensus_queue.cc:1035] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:27.724349 5973 consensus_queue.cc:1035] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [LEADER]: Connected to new peer: Peer: permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:27.732010 5988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:27.729293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:42599 (local address 127.2.55.129:37003)
0811 16:47:27.729431 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:27.729443 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:27.729502 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:27.729651 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:27.729653 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:27.729656 (+ 3us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:47:27.729707 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:27.729709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:27.730427 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:27.730428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:27.731031 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:27.731034 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:27.731551 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:27.731552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:27.731628 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:27.731634 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:47:27.731803 (+ 169us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:47:27.731806 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:47:27.731860 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 16:47:27.731919 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":91,"threads_started":1}
I20260811 16:47:27.731951 5977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:27.729330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:37003 (local address 127.2.55.131:42599)
0811 16:47:27.729375 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:27.729377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:27.729489 (+ 112us) server_negotiation.cc:407] Connection header received
0811 16:47:27.729557 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:27.729558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:27.729569 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:27.729632 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:27.729778 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:27.730304 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:27.731170 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:27.731481 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:27.731552 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:27.731707 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:27.731745 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:27.731800 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:27.731865 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 16:47:27.731886 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:47:27.738708 5042 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46536:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:27.738799 5042 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46536:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:27.739534 5042 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00: Sending DeleteTablet for 3 replicas of tablet c2cb2e1bfaea4e7a8e1cd4d22be20549
I20260811 16:47:27.739820 5701 tablet_service.cc:1514] Processing DeleteTablet for tablet c2cb2e1bfaea4e7a8e1cd4d22be20549 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:27 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:57590
I20260811 16:47:27.739876 5490 tablet_service.cc:1514] Processing DeleteTablet for tablet c2cb2e1bfaea4e7a8e1cd4d22be20549 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:27 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:52544
I20260811 16:47:27.739915 5943 tablet_replica.cc:330] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858: stopping tablet replica
I20260811 16:47:27.739962 5943 raft_consensus.cc:2229] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:47:27.739976 5942 tablet_replica.cc:330] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba: stopping tablet replica
I20260811 16:47:27.740025 5942 raft_consensus.cc:2229] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:27.740036 5943 raft_consensus.cc:2258] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:27.740067 5942 raft_consensus.cc:2258] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:27.740146 5270 tablet_service.cc:1514] Processing DeleteTablet for tablet c2cb2e1bfaea4e7a8e1cd4d22be20549 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:27 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:57392
I20260811 16:47:27.740079 5042 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46536:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 16:47:27.740237 5940 tablet_replica.cc:330] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1: stopping tablet replica
W20260811 16:47:27.740245 5042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:27.740288 5940 raft_consensus.cc:2229] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:27.740312 5940 raft_consensus.cc:2258] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:27.740523 5943 ts_tablet_manager.cc:1905] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:27.741498 5270 tablet_service.cc:1467] Processing CreateTablet for tablet ca779edf8c1a4eab9cfe1d0d7a88a806 (DEFAULT_TABLE table=test-table [id=5960049158a24c1e802ae3222d1e2a36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:27.741608 5701 tablet_service.cc:1467] Processing CreateTablet for tablet ca779edf8c1a4eab9cfe1d0d7a88a806 (DEFAULT_TABLE table=test-table [id=5960049158a24c1e802ae3222d1e2a36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:27.741616 5270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca779edf8c1a4eab9cfe1d0d7a88a806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:27.741722 5701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca779edf8c1a4eab9cfe1d0d7a88a806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:27.742424 5940 ts_tablet_manager.cc:1905] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:27.742475 5490 tablet_service.cc:1467] Processing CreateTablet for tablet ca779edf8c1a4eab9cfe1d0d7a88a806 (DEFAULT_TABLE table=test-table [id=5960049158a24c1e802ae3222d1e2a36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:27.742588 5490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca779edf8c1a4eab9cfe1d0d7a88a806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:27.743057 5962 tablet_bootstrap.cc:492] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1: Bootstrap starting.
I20260811 16:47:27.743363 5962 tablet_bootstrap.cc:654] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:27.743830 5940 ts_tablet_manager.cc:1918] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:47:27.743872 5940 log.cc:1196] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-0/wal/wals/c2cb2e1bfaea4e7a8e1cd4d22be20549
I20260811 16:47:27.744043 5959 tablet_bootstrap.cc:492] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba: Bootstrap starting.
I20260811 16:47:27.744077 5940 ts_tablet_manager.cc:1939] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 276e293bb59d42c5b04553ca9813f8a1: Deleting consensus metadata
I20260811 16:47:27.744408 5943 ts_tablet_manager.cc:1918] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:47:27.744467 5943 log.cc:1196] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/c2cb2e1bfaea4e7a8e1cd4d22be20549
I20260811 16:47:27.744582 5959 tablet_bootstrap.cc:654] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:27.744692 5943 ts_tablet_manager.cc:1939] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 926d0204689947e2b45522e253eeb858: Deleting consensus metadata
I20260811 16:47:27.744798 5942 ts_tablet_manager.cc:1905] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:27.745009 5022 catalog_manager.cc:4841] TS 926d0204689947e2b45522e253eeb858 (127.2.55.131:42599): tablet c2cb2e1bfaea4e7a8e1cd4d22be20549 (table test-table [id=627919f82d634df39585e97732f2f944]) successfully deleted
I20260811 16:47:27.745296 5959 tablet_bootstrap.cc:492] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba: No bootstrap required, opened a new log
I20260811 16:47:27.745357 5959 ts_tablet_manager.cc:1397] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:27.745510 5959 raft_consensus.cc:348] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:27.745582 5959 raft_consensus.cc:374] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:27.745610 5959 raft_consensus.cc:729] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44b167c0813d468f81fbdd37646cd6ba, State: Initialized, Role: FOLLOWER
I20260811 16:47:27.745653 5959 consensus_queue.cc:260] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:27.745748 5959 ts_tablet_manager.cc:1428] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 16:47:27.746286 5942 ts_tablet_manager.cc:1918] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:47:27.746352 5942 log.cc:1196] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/c2cb2e1bfaea4e7a8e1cd4d22be20549
I20260811 16:47:27.746378 5020 catalog_manager.cc:4841] TS 276e293bb59d42c5b04553ca9813f8a1 (127.2.55.129:43955): tablet c2cb2e1bfaea4e7a8e1cd4d22be20549 (table test-table [id=627919f82d634df39585e97732f2f944]) successfully deleted
I20260811 16:47:27.746587 5942 ts_tablet_manager.cc:1939] T c2cb2e1bfaea4e7a8e1cd4d22be20549 P 44b167c0813d468f81fbdd37646cd6ba: Deleting consensus metadata
I20260811 16:47:27.746778 5963 tablet_bootstrap.cc:492] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858: Bootstrap starting.
I20260811 16:47:27.746846 5962 tablet_bootstrap.cc:492] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1: No bootstrap required, opened a new log
I20260811 16:47:27.746902 5962 ts_tablet_manager.cc:1397] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 16:47:27.746970 5021 catalog_manager.cc:4841] TS 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385): tablet c2cb2e1bfaea4e7a8e1cd4d22be20549 (table test-table [id=627919f82d634df39585e97732f2f944]) successfully deleted
I20260811 16:47:27.747018 5962 raft_consensus.cc:348] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:27.747092 5962 raft_consensus.cc:374] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:27.747123 5962 raft_consensus.cc:729] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 276e293bb59d42c5b04553ca9813f8a1, State: Initialized, Role: FOLLOWER
I20260811 16:47:27.747171 5962 consensus_queue.cc:260] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:27.747255 5962 ts_tablet_manager.cc:1428] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:27.747306 5963 tablet_bootstrap.cc:654] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:27.748044 5963 tablet_bootstrap.cc:492] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858: No bootstrap required, opened a new log
I20260811 16:47:27.748097 5963 ts_tablet_manager.cc:1397] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:27.748260 5963 raft_consensus.cc:348] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:27.748332 5963 raft_consensus.cc:374] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:27.748353 5963 raft_consensus.cc:729] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926d0204689947e2b45522e253eeb858, State: Initialized, Role: FOLLOWER
I20260811 16:47:27.748392 5963 consensus_queue.cc:260] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:27.748482 5963 ts_tablet_manager.cc:1428] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:28.019057 5915 raft_consensus.cc:482] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:28.019183 5915 raft_consensus.cc:504] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:28.019366 5915 leader_election.cc:288] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385), 926d0204689947e2b45522e253eeb858 (127.2.55.131:42599)
I20260811 16:47:28.019754 5728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca779edf8c1a4eab9cfe1d0d7a88a806" candidate_uuid: "276e293bb59d42c5b04553ca9813f8a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926d0204689947e2b45522e253eeb858" is_pre_election: true
I20260811 16:47:28.019860 5728 raft_consensus.cc:2454] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 276e293bb59d42c5b04553ca9813f8a1 in term 0.
I20260811 16:47:28.019830 5525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca779edf8c1a4eab9cfe1d0d7a88a806" candidate_uuid: "276e293bb59d42c5b04553ca9813f8a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b167c0813d468f81fbdd37646cd6ba" is_pre_election: true
I20260811 16:47:28.019980 5525 raft_consensus.cc:2454] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 276e293bb59d42c5b04553ca9813f8a1 in term 0.
I20260811 16:47:28.020068 5200 leader_election.cc:302] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 276e293bb59d42c5b04553ca9813f8a1, 926d0204689947e2b45522e253eeb858; no voters:
I20260811 16:47:28.020160 5915 raft_consensus.cc:2781] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:28.020207 5915 raft_consensus.cc:482] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:28.020238 5915 raft_consensus.cc:3037] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:28.021031 5915 raft_consensus.cc:504] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:28.021193 5915 leader_election.cc:288] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [CANDIDATE]: Term 1 election: Requested vote from peers 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385), 926d0204689947e2b45522e253eeb858 (127.2.55.131:42599)
I20260811 16:47:28.021335 5525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca779edf8c1a4eab9cfe1d0d7a88a806" candidate_uuid: "276e293bb59d42c5b04553ca9813f8a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44b167c0813d468f81fbdd37646cd6ba"
I20260811 16:47:28.021413 5525 raft_consensus.cc:3037] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:28.021373 5728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca779edf8c1a4eab9cfe1d0d7a88a806" candidate_uuid: "276e293bb59d42c5b04553ca9813f8a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "926d0204689947e2b45522e253eeb858"
I20260811 16:47:28.021495 5728 raft_consensus.cc:3037] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:28.022146 5728 raft_consensus.cc:2454] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 276e293bb59d42c5b04553ca9813f8a1 in term 1.
I20260811 16:47:28.022218 5525 raft_consensus.cc:2454] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 276e293bb59d42c5b04553ca9813f8a1 in term 1.
I20260811 16:47:28.022403 5200 leader_election.cc:302] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 276e293bb59d42c5b04553ca9813f8a1, 926d0204689947e2b45522e253eeb858; no voters:
I20260811 16:47:28.022503 5915 raft_consensus.cc:2781] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:28.022565 5915 raft_consensus.cc:686] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [term 1 LEADER]: Becoming Leader. State: Replica: 276e293bb59d42c5b04553ca9813f8a1, State: Running, Role: LEADER
I20260811 16:47:28.022639 5915 consensus_queue.cc:237] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } }
I20260811 16:47:28.023324 5042 catalog_manager.cc:5495] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 276e293bb59d42c5b04553ca9813f8a1 (127.2.55.129). New cstate: current_term: 1 leader_uuid: "276e293bb59d42c5b04553ca9813f8a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "276e293bb59d42c5b04553ca9813f8a1" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260811 16:47:28.033326 5982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:28.031115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57414 (local address 127.2.55.129:43955)
0811 16:47:28.031166 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:28.031168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:28.031211 (+ 43us) server_negotiation.cc:407] Connection header received
0811 16:47:28.031270 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:28.031271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:28.031281 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:28.031324 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:28.031406 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:28.031942 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:28.032616 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:28.032832 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:28.032921 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:28.033087 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:28.033114 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:28.033157 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:28.033214 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 16:47:28.033233 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:47:28.035786 5728 raft_consensus.cc:1261] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Refusing update from remote peer 276e293bb59d42c5b04553ca9813f8a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:28.035804 5525 raft_consensus.cc:1261] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Refusing update from remote peer 276e293bb59d42c5b04553ca9813f8a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:28.036010 5915 consensus_queue.cc:1035] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44b167c0813d468f81fbdd37646cd6ba" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:28.036098 5848 consensus_queue.cc:1035] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 276e293bb59d42c5b04553ca9813f8a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "926d0204689947e2b45522e253eeb858" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 16:47:28.040607 5912 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 16:47:29.557173 5042 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46536:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:29.557299 5042 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46536:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:29.558133 5042 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8b0e641395b948408e669322f3e3ad00: Sending DeleteTablet for 3 replicas of tablet ca779edf8c1a4eab9cfe1d0d7a88a806
I20260811 16:47:29.558398 5270 tablet_service.cc:1514] Processing DeleteTablet for tablet ca779edf8c1a4eab9cfe1d0d7a88a806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:29 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:57392
I20260811 16:47:29.558451 5490 tablet_service.cc:1514] Processing DeleteTablet for tablet ca779edf8c1a4eab9cfe1d0d7a88a806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:29 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:52544
I20260811 16:47:29.558504 5701 tablet_service.cc:1514] Processing DeleteTablet for tablet ca779edf8c1a4eab9cfe1d0d7a88a806 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:29 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:57590
I20260811 16:47:29.558559 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 5165
I20260811 16:47:29.569840 6036 tablet_replica.cc:330] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba: stopping tablet replica
I20260811 16:47:29.569945 6036 raft_consensus.cc:2229] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:29.569998 6036 raft_consensus.cc:2258] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:29.571136 6037 tablet_replica.cc:330] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858: stopping tablet replica
I20260811 16:47:29.571271 6037 raft_consensus.cc:2229] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:29.571357 6037 raft_consensus.cc:2258] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:29.571403 6036 ts_tablet_manager.cc:1905] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:29.571672 6037 ts_tablet_manager.cc:1905] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:29.572978 6036 ts_tablet_manager.cc:1918] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 16:47:29.573127 6036 log.cc:1196] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/ca779edf8c1a4eab9cfe1d0d7a88a806
I20260811 16:47:29.573359 6036 ts_tablet_manager.cc:1939] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 44b167c0813d468f81fbdd37646cd6ba: Deleting consensus metadata
I20260811 16:47:29.573789 6037 ts_tablet_manager.cc:1918] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 16:47:29.573803 5021 catalog_manager.cc:4841] TS 44b167c0813d468f81fbdd37646cd6ba (127.2.55.130:33385): tablet ca779edf8c1a4eab9cfe1d0d7a88a806 (table test-table [id=5960049158a24c1e802ae3222d1e2a36]) successfully deleted
I20260811 16:47:29.573861 6037 log.cc:1196] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/ca779edf8c1a4eab9cfe1d0d7a88a806
I20260811 16:47:29.574079 6037 ts_tablet_manager.cc:1939] T ca779edf8c1a4eab9cfe1d0d7a88a806 P 926d0204689947e2b45522e253eeb858: Deleting consensus metadata
I20260811 16:47:29.574424 5022 catalog_manager.cc:4841] TS 926d0204689947e2b45522e253eeb858 (127.2.55.131:42599): tablet ca779edf8c1a4eab9cfe1d0d7a88a806 (table test-table [id=5960049158a24c1e802ae3222d1e2a36]) successfully deleted
W20260811 16:47:29.578109 5020 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.55.129:43955 (error 108)
I20260811 16:47:29.578438 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 5388
I20260811 16:47:29.586126 6039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:29.578564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:43955 (local address 127.0.0.1:57850)
0811 16:47:29.585989 (+ 7425us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:29.586076 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:43955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7385,"thread_start_us":68,"threads_started":1}
W20260811 16:47:29.586299 5020 catalog_manager.cc:4584] TS 276e293bb59d42c5b04553ca9813f8a1 (127.2.55.129:43955): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ca779edf8c1a4eab9cfe1d0d7a88a806: Network error: Client connection negotiation failed: client connection to 127.2.55.129:43955: connect: Connection refused (error 111)
I20260811 16:47:29.596473 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 5605
I20260811 16:47:29.612828 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 4990
2026-08-11T16:47:29Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6443 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:47:29 dist-test-slave-3h5h krb5kdc[6043](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:47:29 dist-test-slave-3h5h krb5kdc[6043](info): set up 2 sockets
Aug 11 16:47:29 dist-test-slave-3h5h krb5kdc[6043](info): commencing operation
krb5kdc: starting...
W20260811 16:47:30.883749 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:47:30 dist-test-slave-3h5h krb5kdc[6043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:47:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:47:31.020896 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:36707
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:44405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:36707
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:31.113211 6064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:31.113457 6064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:31.113498 6064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:31.114822 6064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:31.114893 6064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:31.114921 6064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:31.114953 6064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:31.114979 6064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:31.116573 6064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:36707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:36707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:31.116912 6064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:31.117167 6064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:31.122730 6071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:31.122725 6074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:31.122725 6064 server_base.cc:1034] running on GCE node
W20260811 16:47:31.123082 6072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:31.123356 6064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:31.123709 6064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:31.124991 6064 hybrid_clock.cc:648] HybridClock initialized: now 1786466851124965 us; error 43 us; skew 500 ppm
Aug 11 16:47:31 dist-test-slave-3h5h krb5kdc[6043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466851, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:31.128800 6064 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:47:31.129308 6064 webserver.cc:460] Webserver started at http://127.2.55.190:45609/ using document root <none> and password file <none>
I20260811 16:47:31.129565 6064 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:31.129637 6064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:31.129777 6064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:31.130915 6064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "ad07edd05e6542b89e74899ab5fe046e"
format_stamp: "Formatted at 2026-08-11 16:47:31 on dist-test-slave-3h5h"
server_key: "c0f6da3f973b7cedcdeb4f66fa8d43ed"
server_key_iv: "c76a8ebb3b0157e09723c2f3f6838ea1"
server_key_version: "encryptionkey@0"
I20260811 16:47:31.131276 6064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "ad07edd05e6542b89e74899ab5fe046e"
format_stamp: "Formatted at 2026-08-11 16:47:31 on dist-test-slave-3h5h"
server_key: "c0f6da3f973b7cedcdeb4f66fa8d43ed"
server_key_iv: "c76a8ebb3b0157e09723c2f3f6838ea1"
server_key_version: "encryptionkey@0"
I20260811 16:47:31.132812 6064 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:31.133808 6082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:31.134006 6064 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:31.134120 6064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "ad07edd05e6542b89e74899ab5fe046e"
format_stamp: "Formatted at 2026-08-11 16:47:31 on dist-test-slave-3h5h"
server_key: "c0f6da3f973b7cedcdeb4f66fa8d43ed"
server_key_iv: "c76a8ebb3b0157e09723c2f3f6838ea1"
server_key_version: "encryptionkey@0"
I20260811 16:47:31.134197 6064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:31.143816 6064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:31.146153 6064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:31.146314 6064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:31.150969 6064 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:36707
I20260811 16:47:31.151053 6172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:36707 every 8 connection(s)
I20260811 16:47:31.151422 6064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:31.152522 6173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:31.156675 6173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e: Bootstrap starting.
I20260811 16:47:31.156972 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 6064
I20260811 16:47:31.157135 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:31.157348 2270 external_mini_cluster.cc:1428] Setting key eadcf015bd1156c7e7c1654cd0a769c7
I20260811 16:47:31.157560 6173 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:31.157968 6173 log.cc:824] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:31.158907 6173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e: No bootstrap required, opened a new log
I20260811 16:47:31.161188 6173 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad07edd05e6542b89e74899ab5fe046e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 36707 } }
I20260811 16:47:31.161353 6173 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:31.161384 6173 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad07edd05e6542b89e74899ab5fe046e, State: Initialized, Role: FOLLOWER
I20260811 16:47:31.161528 6173 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad07edd05e6542b89e74899ab5fe046e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 36707 } }
I20260811 16:47:31.161648 6173 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:31.161717 6173 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:31.161790 6173 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:31.162336 6173 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad07edd05e6542b89e74899ab5fe046e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 36707 } }
I20260811 16:47:31.162456 6173 leader_election.cc:302] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad07edd05e6542b89e74899ab5fe046e; no voters:
I20260811 16:47:31.162667 6173 leader_election.cc:288] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:31.162698 6183 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:31.162915 6183 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [term 1 LEADER]: Becoming Leader. State: Replica: ad07edd05e6542b89e74899ab5fe046e, State: Running, Role: LEADER
I20260811 16:47:31.163003 6173 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:31.163051 6183 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad07edd05e6542b89e74899ab5fe046e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 36707 } }
I20260811 16:47:31.163444 6183 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad07edd05e6542b89e74899ab5fe046e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad07edd05e6542b89e74899ab5fe046e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 36707 } } }
I20260811 16:47:31.163604 6183 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:31.163794 6183 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad07edd05e6542b89e74899ab5fe046e. Latest consensus state: current_term: 1 leader_uuid: "ad07edd05e6542b89e74899ab5fe046e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad07edd05e6542b89e74899ab5fe046e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 36707 } } }
I20260811 16:47:31.163918 6183 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:31.164098 6196 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:31.164697 6196 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 16:47:31 dist-test-slave-3h5h krb5kdc[6043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:31.166733 6196 catalog_manager.cc:1347] Generated new cluster ID: 40c0d50945fb4d13b006ae0fc214542a
I20260811 16:47:31.167634 6196 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:47:31.171754 6180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:31.158071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58112 (local address 127.2.55.190:36707)
0811 16:47:31.158271 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:31.158282 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:31.158321 (+ 39us) server_negotiation.cc:407] Connection header received
0811 16:47:31.158894 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:31.158903 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:31.158966 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:31.159192 (+ 226us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:31.160105 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:31.161556 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:31.162833 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:31.163594 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:31.163716 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:31.167431 (+ 3715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:31.167435 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:31.167435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:31.167447 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:31.169664 (+ 2217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:31.170101 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:31.170105 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:31.170105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:31.170215 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:31.170449 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:31.170450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:31.170450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:31.170761 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:31.171302 (+ 541us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:31.171383 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 16:47:31.171521 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":104,"threads_started":1}
I20260811 16:47:31.176177 6196 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:31.177011 6196 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:31.195379 6196 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad07edd05e6542b89e74899ab5fe046e: Generated new TSK 0
I20260811 16:47:31.195729 6196 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:47:31.228087 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:36707
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:44405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:31.323566 6216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:31.323812 6216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:31.323858 6216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:31.325282 6216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:31.325352 6216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:31.325402 6216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:47:31.327078 6216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:36707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:31.327389 6216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:31.327644 6216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:31.333365 6226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:31.333375 6231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:31.333673 6225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:31.334607 6216 server_base.cc:1034] running on GCE node
I20260811 16:47:31.334851 6216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:31.335140 6216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:31.336305 6216 hybrid_clock.cc:648] HybridClock initialized: now 1786466851336282 us; error 40 us; skew 500 ppm
Aug 11 16:47:31 dist-test-slave-3h5h krb5kdc[6043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466851, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:31.339277 6216 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:47:31.339821 6216 webserver.cc:460] Webserver started at http://127.2.55.129:37047/ using document root <none> and password file <none>
I20260811 16:47:31.340082 6216 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:31.340153 6216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:31.340305 6216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:31.341570 6216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "40ea526505e944939964c889b0c03bee"
format_stamp: "Formatted at 2026-08-11 16:47:31 on dist-test-slave-3h5h"
server_key: "9cd5102830c1b516b492715d2052077b"
server_key_iv: "3cbcdb15b56126e9eda91752e45930f0"
server_key_version: "encryptionkey@0"
I20260811 16:47:31.341974 6216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "40ea526505e944939964c889b0c03bee"
format_stamp: "Formatted at 2026-08-11 16:47:31 on dist-test-slave-3h5h"
server_key: "9cd5102830c1b516b492715d2052077b"
server_key_iv: "3cbcdb15b56126e9eda91752e45930f0"
server_key_version: "encryptionkey@0"
I20260811 16:47:31.343587 6216 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:47:31.344547 6243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:31.344730 6216 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:31.344856 6216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "40ea526505e944939964c889b0c03bee"
format_stamp: "Formatted at 2026-08-11 16:47:31 on dist-test-slave-3h5h"
server_key: "9cd5102830c1b516b492715d2052077b"
server_key_iv: "3cbcdb15b56126e9eda91752e45930f0"
server_key_version: "encryptionkey@0"
I20260811 16:47:31.344955 6216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:31.356236 6216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:31.358852 6216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:31.359046 6216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:31.359359 6216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:31.359786 6216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:31.359841 6216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:31.359917 6216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:31.359966 6216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:31.368002 6216 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:37927
I20260811 16:47:31.368079 6416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:37927 every 8 connection(s)
I20260811 16:47:31.368459 6216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:47:31.374279 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 6216
I20260811 16:47:31.374389 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:47:31.374586 2270 external_mini_cluster.cc:1428] Setting key b6ff3a021aeb9f3c9eb85b770a782d51
Aug 11 16:47:31 dist-test-slave-3h5h krb5kdc[6043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466851, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:31.381155 6180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:31.369649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:49465 (local address 127.2.55.190:36707)
0811 16:47:31.369724 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:31.369727 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:31.369742 (+ 15us) server_negotiation.cc:407] Connection header received
0811 16:47:31.370230 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:31.370232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:31.370245 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:31.370338 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:31.371360 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:31.372187 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:31.373398 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:31.373729 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:31.373808 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:31.376557 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:31.376559 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:31.376559 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:31.376567 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:31.379289 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:31.379947 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:31.379948 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:31.379949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:31.380019 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:31.380325 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:31.380327 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:31.380327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:31.380485 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:31.380564 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:31.380903 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 16:47:31.381011 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:47:31.381302 6421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:31.369355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:36707 (local address 127.2.55.129:49465)
0811 16:47:31.369532 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:31.369581 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:31.370123 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:31.370396 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:31.370399 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:31.371046 (+ 647us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:31.371251 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:31.371257 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:31.372375 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:31.372376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:31.373307 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:31.373310 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:31.373831 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:31.373832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:31.373932 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:31.374560 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:31.374571 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:31.376454 (+ 1883us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:31.379389 (+ 2935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:31.379399 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:31.379401 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:31.379835 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:31.380099 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:31.380101 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:31.380101 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:31.380244 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:31.380561 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:31.380568 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:31.380728 (+ 160us) client_negotiation.cc:769] Sending connection context
0811 16:47:31.380883 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 16:47:31.381055 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
I20260811 16:47:31.382051 6417 heartbeater.cc:347] Connected to a master server at 127.2.55.190:36707
I20260811 16:47:31.382164 6417 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:31.382402 6417 heartbeater.cc:511] Master 127.2.55.190:36707 requested a full tablet report, sending...
I20260811 16:47:31.382961 6112 ts_manager.cc:194] Registered new tserver with Master: 40ea526505e944939964c889b0c03bee (127.2.55.129:37927)
I20260811 16:47:31.383837 6112 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:49465
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:47:31.403887 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:36707
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:44405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:31.488821 6425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:31.489053 6425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:31.489075 6425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:31.490191 6425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:31.490229 6425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:31.490255 6425 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:47:31.491703 6425 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:36707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:31.491902 6425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:31.492100 6425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:31.497259 6442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:31.497292 6435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:31.497272 6436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:31.497519 6425 server_base.cc:1034] running on GCE node
I20260811 16:47:31.497771 6425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:31.498046 6425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:31.499225 6425 hybrid_clock.cc:648] HybridClock initialized: now 1786466851499210 us; error 30 us; skew 500 ppm
Aug 11 16:47:31 dist-test-slave-3h5h krb5kdc[6043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466851, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:31.501901 6425 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:47:31.502420 6425 webserver.cc:460] Webserver started at http://127.2.55.130:42441/ using document root <none> and password file <none>
I20260811 16:47:31.502683 6425 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:31.502754 6425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:31.502902 6425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:31.503995 6425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "508c1f21f03047708cefd8318bc26d50"
format_stamp: "Formatted at 2026-08-11 16:47:31 on dist-test-slave-3h5h"
server_key: "96399ab3d3889d6e0e82007389bcd57a"
server_key_iv: "3e22e9138d3869e0e693ba9b7b6e4c24"
server_key_version: "encryptionkey@0"
I20260811 16:47:31.504374 6425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "508c1f21f03047708cefd8318bc26d50"
format_stamp: "Formatted at 2026-08-11 16:47:31 on dist-test-slave-3h5h"
server_key: "96399ab3d3889d6e0e82007389bcd57a"
server_key_iv: "3e22e9138d3869e0e693ba9b7b6e4c24"
server_key_version: "encryptionkey@0"
I20260811 16:47:31.505815 6425 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:31.506657 6450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:31.506865 6425 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:31.506935 6425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "508c1f21f03047708cefd8318bc26d50"
format_stamp: "Formatted at 2026-08-11 16:47:31 on dist-test-slave-3h5h"
server_key: "96399ab3d3889d6e0e82007389bcd57a"
server_key_iv: "3e22e9138d3869e0e693ba9b7b6e4c24"
server_key_version: "encryptionkey@0"
I20260811 16:47:31.506990 6425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:31.521243 6425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:31.523679 6425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:31.523806 6425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:31.524017 6425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:31.524451 6425 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:31.524510 6425 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:31.524554 6425 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:31.524577 6425 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:31.530790 6425 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:44027
I20260811 16:47:31.530862 6637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:44027 every 8 connection(s)
I20260811 16:47:31.531209 6425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:47:31 dist-test-slave-3h5h krb5kdc[6043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466851, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:31.540135 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 6425
I20260811 16:47:31.540235 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:47:31.540413 2270 external_mini_cluster.cc:1428] Setting key bc13b099f9a2b74424a82a59a396ff50
I20260811 16:47:31.540657 6180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:31.531995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:50033 (local address 127.2.55.190:36707)
0811 16:47:31.532056 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:31.532059 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:31.532285 (+ 226us) server_negotiation.cc:407] Connection header received
0811 16:47:31.532827 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:31.532849 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:31.532864 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:31.532928 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:31.533904 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:31.534427 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:31.535454 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:31.535659 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:31.535745 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:31.537997 (+ 2252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:31.537999 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:31.537999 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:31.538008 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:31.539239 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:31.539652 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:31.539654 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:31.539654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:31.539718 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:31.539961 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:31.539962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:31.539962 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:31.540081 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:31.540152 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:31.540468 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 16:47:31.540564 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:47:31.540867 6645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:31.531972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:36707 (local address 127.2.55.130:50033)
0811 16:47:31.532158 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:31.532197 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:31.532717 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:31.533009 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:31.533013 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:31.533588 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:31.533798 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:31.533803 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:31.534545 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:31.534546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:31.535358 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:31.535360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:31.535759 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:31.535760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:31.535891 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:31.536425 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:31.536434 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:31.537897 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:31.539337 (+ 1440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:31.539345 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:31.539347 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:31.539575 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:31.539783 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:31.539784 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:31.539785 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:31.539887 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:31.540153 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:31.540162 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:31.540324 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 16:47:31.540443 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 16:47:31.540606 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":82,"threads_started":1}
I20260811 16:47:31.541410 6638 heartbeater.cc:347] Connected to a master server at 127.2.55.190:36707
I20260811 16:47:31.541527 6638 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:31.541721 6638 heartbeater.cc:511] Master 127.2.55.190:36707 requested a full tablet report, sending...
I20260811 16:47:31.542128 6112 ts_manager.cc:194] Registered new tserver with Master: 508c1f21f03047708cefd8318bc26d50 (127.2.55.130:44027)
I20260811 16:47:31.542512 6112 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:50033
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:47:31.568461 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:36707
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:44405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:31.655478 6651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:31.655707 6651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:31.655732 6651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:31.656858 6651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:31.656899 6651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:31.656927 6651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:47:31.658344 6651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:36707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:31.658545 6651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:31.658794 6651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:31.664340 6664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:31.664412 6666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:31.664381 6663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:31.664485 6651 server_base.cc:1034] running on GCE node
I20260811 16:47:31.664892 6651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:31.665215 6651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:31.666409 6651 hybrid_clock.cc:648] HybridClock initialized: now 1786466851666396 us; error 29 us; skew 500 ppm
Aug 11 16:47:31 dist-test-slave-3h5h krb5kdc[6043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466851, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:31.669167 6651 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:47:31.669698 6651 webserver.cc:460] Webserver started at http://127.2.55.131:38105/ using document root <none> and password file <none>
I20260811 16:47:31.669938 6651 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:31.669992 6651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:31.670163 6651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:31.671330 6651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "905d1eb7197f44f08e06ab16e157b75b"
format_stamp: "Formatted at 2026-08-11 16:47:31 on dist-test-slave-3h5h"
server_key: "7bcafbb28b4ebca7cfdda5030b50228e"
server_key_iv: "60d7006cdf65b2cb265fc02b45391cc5"
server_key_version: "encryptionkey@0"
I20260811 16:47:31.671729 6651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "905d1eb7197f44f08e06ab16e157b75b"
format_stamp: "Formatted at 2026-08-11 16:47:31 on dist-test-slave-3h5h"
server_key: "7bcafbb28b4ebca7cfdda5030b50228e"
server_key_iv: "60d7006cdf65b2cb265fc02b45391cc5"
server_key_version: "encryptionkey@0"
I20260811 16:47:31.673187 6651 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:47:31.673996 6673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:31.674178 6651 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:31.674288 6651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "905d1eb7197f44f08e06ab16e157b75b"
format_stamp: "Formatted at 2026-08-11 16:47:31 on dist-test-slave-3h5h"
server_key: "7bcafbb28b4ebca7cfdda5030b50228e"
server_key_iv: "60d7006cdf65b2cb265fc02b45391cc5"
server_key_version: "encryptionkey@0"
I20260811 16:47:31.674372 6651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:31.705139 6651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:31.707245 6651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:31.707425 6651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:31.707656 6651 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:31.707955 6651 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:31.707988 6651 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:31.708011 6651 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:31.708024 6651 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:31.714113 6651 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:33165
I20260811 16:47:31.714208 6864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:33165 every 8 connection(s)
I20260811 16:47:31.714527 6651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:47:31.714969 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 6651
I20260811 16:47:31.715042 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:47:31.715242 2270 external_mini_cluster.cc:1428] Setting key 51e0d198a164968de5f78f29217a08a4
Aug 11 16:47:31 dist-test-slave-3h5h krb5kdc[6043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466851, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:31.724686 6180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:31.715419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:57997 (local address 127.2.55.190:36707)
0811 16:47:31.715554 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:31.715557 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:31.715785 (+ 228us) server_negotiation.cc:407] Connection header received
0811 16:47:31.716452 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:31.716454 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:31.716471 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:31.716533 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:31.717546 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:31.718132 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:31.719157 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:31.719451 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:31.719532 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:31.721786 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:31.721788 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:31.721788 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:31.721795 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:31.723427 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:31.723840 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:31.723841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:31.723841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:31.723900 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:31.724123 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:31.724124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:31.724124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:31.724244 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:31.724304 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:31.724542 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 16:47:31.724612 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260811 16:47:31.724961 6868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:31.715412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:36707 (local address 127.2.55.131:57997)
0811 16:47:31.715631 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:31.715681 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:31.716343 (+ 662us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:31.716585 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:31.716588 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:31.717255 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:31.717449 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:31.717453 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:31.718232 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:31.718233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:31.719019 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:31.719020 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:31.719542 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:31.719543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:31.719646 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:31.720181 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:31.720191 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:31.721686 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:31.723520 (+ 1834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:31.723527 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:31.723529 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:31.723769 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:31.723960 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:31.723960 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:31.723961 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:31.724064 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:31.724301 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:31.724306 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:31.724428 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 16:47:31.724511 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 16:47:31.724638 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":123,"threads_started":1}
I20260811 16:47:31.725535 6865 heartbeater.cc:347] Connected to a master server at 127.2.55.190:36707
I20260811 16:47:31.725643 6865 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:31.725808 6865 heartbeater.cc:511] Master 127.2.55.190:36707 requested a full tablet report, sending...
I20260811 16:47:31.726197 6112 ts_manager.cc:194] Registered new tserver with Master: 905d1eb7197f44f08e06ab16e157b75b (127.2.55.131:33165)
I20260811 16:47:31.726773 6112 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:57997
I20260811 16:47:31.727037 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 16:47:31.740624 6180 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:31.739604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58118 (local address 127.2.55.190:36707)
0811 16:47:31.739669 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:31.739671 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:31.739826 (+ 155us) server_negotiation.cc:407] Connection header received
0811 16:47:31.739916 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:31.739917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:31.739926 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:31.739972 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:31.740534 (+ 562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58118: BlockingRecv error: recv got EOF from 127.0.0.1:58118 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:47:31.741533 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 6216
I20260811 16:47:31.750946 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 6425
I20260811 16:47:31.761116 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 6651
I20260811 16:47:31.774560 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 6064
2026-08-11T16:47:31Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2149 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:47:31 dist-test-slave-3h5h krb5kdc[6882](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:47:31 dist-test-slave-3h5h krb5kdc[6882](info): set up 2 sockets
Aug 11 16:47:31 dist-test-slave-3h5h krb5kdc[6882](info): commencing operation
krb5kdc: starting...
W20260811 16:47:33.079118 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:47:33 dist-test-slave-3h5h krb5kdc[6882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466853, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:47:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:47:33.214135 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:33185
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:37563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:33185
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:33.304740 6897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:33.305127 6897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:33.305193 6897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:33.306543 6897 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:33.306592 6897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:33.306607 6897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:33.306620 6897 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:33.306632 6897 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:33.308233 6897 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:37563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:33185
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:33185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:33.308445 6897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:33.308625 6897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:33.314103 6912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:33.314107 6908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:33.314141 6903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:33.314505 6897 server_base.cc:1034] running on GCE node
I20260811 16:47:33.314757 6897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:33.315080 6897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:33.316259 6897 hybrid_clock.cc:648] HybridClock initialized: now 1786466853316239 us; error 44 us; skew 500 ppm
Aug 11 16:47:33 dist-test-slave-3h5h krb5kdc[6882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466853, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:33.322656 6897 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:47:33.323140 6897 webserver.cc:460] Webserver started at http://127.2.55.190:41163/ using document root <none> and password file <none>
I20260811 16:47:33.323364 6897 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:33.323411 6897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:33.323520 6897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:33.324708 6897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "6805a1b9e37e4c8b857ad74b780a8397"
format_stamp: "Formatted at 2026-08-11 16:47:33 on dist-test-slave-3h5h"
server_key: "89aebbd1e4c17f634bd72fdeadfe4685"
server_key_iv: "09553f9b677890f64ee1acd3317a926c"
server_key_version: "encryptionkey@0"
I20260811 16:47:33.325134 6897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "6805a1b9e37e4c8b857ad74b780a8397"
format_stamp: "Formatted at 2026-08-11 16:47:33 on dist-test-slave-3h5h"
server_key: "89aebbd1e4c17f634bd72fdeadfe4685"
server_key_iv: "09553f9b677890f64ee1acd3317a926c"
server_key_version: "encryptionkey@0"
I20260811 16:47:33.326565 6897 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:33.327322 6925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:33.327502 6897 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:33.327597 6897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "6805a1b9e37e4c8b857ad74b780a8397"
format_stamp: "Formatted at 2026-08-11 16:47:33 on dist-test-slave-3h5h"
server_key: "89aebbd1e4c17f634bd72fdeadfe4685"
server_key_iv: "09553f9b677890f64ee1acd3317a926c"
server_key_version: "encryptionkey@0"
I20260811 16:47:33.327656 6897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:33.347335 6897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:33.349805 6897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:33.349938 6897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:33.354393 6897 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:33185
I20260811 16:47:33.354491 7007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:33185 every 8 connection(s)
I20260811 16:47:33.354862 6897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:33.355940 7009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:33.358667 7009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397: Bootstrap starting.
I20260811 16:47:33.359364 7009 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:33.359711 7009 log.cc:824] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:33.360491 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 6897
I20260811 16:47:33.360598 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:33.360746 7009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397: No bootstrap required, opened a new log
I20260811 16:47:33.360780 2270 external_mini_cluster.cc:1428] Setting key a38491fbceeb554961fd05f487d46caf
I20260811 16:47:33.363171 7009 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6805a1b9e37e4c8b857ad74b780a8397" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 33185 } }
I20260811 16:47:33.363313 7009 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:33.363337 7009 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6805a1b9e37e4c8b857ad74b780a8397, State: Initialized, Role: FOLLOWER
I20260811 16:47:33.363556 7009 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6805a1b9e37e4c8b857ad74b780a8397" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 33185 } }
I20260811 16:47:33.363669 7009 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:33.363732 7009 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:33.363790 7009 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:33.364529 7009 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6805a1b9e37e4c8b857ad74b780a8397" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 33185 } }
I20260811 16:47:33.364620 7009 leader_election.cc:302] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6805a1b9e37e4c8b857ad74b780a8397; no voters:
I20260811 16:47:33.364885 7009 leader_election.cc:288] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:33.364905 7016 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:33.365077 7016 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [term 1 LEADER]: Becoming Leader. State: Replica: 6805a1b9e37e4c8b857ad74b780a8397, State: Running, Role: LEADER
I20260811 16:47:33.365226 7009 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:33.365234 7016 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6805a1b9e37e4c8b857ad74b780a8397" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 33185 } }
I20260811 16:47:33.365720 7017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6805a1b9e37e4c8b857ad74b780a8397. Latest consensus state: current_term: 1 leader_uuid: "6805a1b9e37e4c8b857ad74b780a8397" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6805a1b9e37e4c8b857ad74b780a8397" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 33185 } } }
I20260811 16:47:33.365813 7017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:33.366072 7019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6805a1b9e37e4c8b857ad74b780a8397" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6805a1b9e37e4c8b857ad74b780a8397" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 33185 } } }
I20260811 16:47:33.366372 7019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:33.366618 7025 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:33.367206 7025 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:33.369009 7025 catalog_manager.cc:1347] Generated new cluster ID: 867973aeb876450983891eb203f8fc3f
I20260811 16:47:33.369063 7025 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:47:33 dist-test-slave-3h5h krb5kdc[6882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466853, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:33.374224 7015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:33.361419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50538 (local address 127.2.55.190:33185)
0811 16:47:33.361645 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:33.361654 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:33.361687 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:47:33.363156 (+ 1469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:33.363165 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:33.363228 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:33.363418 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:33.364263 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:33.365616 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:33.366779 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:33.367411 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:33.367524 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:33.370503 (+ 2979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:33.370508 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:33.370508 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:33.370521 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:33.372507 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:33.372994 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:33.372999 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:33.372999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:33.373123 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:33.373394 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:33.373395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:33.373396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:33.373671 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:33.373861 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:33.373951 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 16:47:33.374063 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":113,"threads_started":1}
I20260811 16:47:33.374404 7025 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:33.375144 7025 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:33.375170 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:47:33.381656 7025 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6805a1b9e37e4c8b857ad74b780a8397: Generated new TSK 0
I20260811 16:47:33.381898 7025 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:47:33.392053 7015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:33.387662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50546 (local address 127.2.55.190:33185)
0811 16:47:33.387718 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:33.387721 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:33.387848 (+ 127us) server_negotiation.cc:407] Connection header received
0811 16:47:33.387902 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:33.387903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:33.387914 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:33.388000 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:33.388588 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:33.389422 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:33.390249 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:33.390620 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:33.390701 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:33.391487 (+ 786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:33.391488 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:33.391489 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:47:33.391747 (+ 258us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:33.391769 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:47:33.391777 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:33.391844 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:33.391937 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 16:47:33.391966 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 16:47:33.394924 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 6897
2026-08-11T16:47:33Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1625 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:47:33 dist-test-slave-3h5h krb5kdc[7056](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:47:33 dist-test-slave-3h5h krb5kdc[7056](info): set up 2 sockets
Aug 11 16:47:33 dist-test-slave-3h5h krb5kdc[7056](info): commencing operation
krb5kdc: starting...
W20260811 16:47:34.674297 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.251s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:47:34 dist-test-slave-3h5h krb5kdc[7056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:47:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:47:34.807691 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:40587
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:46149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:40587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:34.891762 7072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:34.892022 7072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:34.892058 7072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:34.893265 7072 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:34.893340 7072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:34.893365 7072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:34.893395 7072 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:34.893427 7072 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:34.894982 7072 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:46149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:40587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:40587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:34.895269 7072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:34.895510 7072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:34.900442 7077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:34.900462 7082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:34.900454 7079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:34.900664 7072 server_base.cc:1034] running on GCE node
I20260811 16:47:34.901043 7072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:34.901311 7072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:34.902459 7072 hybrid_clock.cc:648] HybridClock initialized: now 1786466854902449 us; error 32 us; skew 500 ppm
Aug 11 16:47:34 dist-test-slave-3h5h krb5kdc[7056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466854, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:34.905216 7072 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:47:34.905692 7072 webserver.cc:460] Webserver started at http://127.2.55.190:39747/ using document root <none> and password file <none>
I20260811 16:47:34.905925 7072 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:34.906024 7072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:34.906172 7072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:34.907261 7072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "d242f848eca4489cac97c694f04936a5"
format_stamp: "Formatted at 2026-08-11 16:47:34 on dist-test-slave-3h5h"
server_key: "d86e1a480b403d659a0cc19515344c9e"
server_key_iv: "8ea5cc14edb9e30d7442c60263aacd77"
server_key_version: "encryptionkey@0"
I20260811 16:47:34.907631 7072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "d242f848eca4489cac97c694f04936a5"
format_stamp: "Formatted at 2026-08-11 16:47:34 on dist-test-slave-3h5h"
server_key: "d86e1a480b403d659a0cc19515344c9e"
server_key_iv: "8ea5cc14edb9e30d7442c60263aacd77"
server_key_version: "encryptionkey@0"
I20260811 16:47:34.909209 7072 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:47:34.910036 7100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:34.910252 7072 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:34.910369 7072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "d242f848eca4489cac97c694f04936a5"
format_stamp: "Formatted at 2026-08-11 16:47:34 on dist-test-slave-3h5h"
server_key: "d86e1a480b403d659a0cc19515344c9e"
server_key_iv: "8ea5cc14edb9e30d7442c60263aacd77"
server_key_version: "encryptionkey@0"
I20260811 16:47:34.910446 7072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:34.929035 7072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:34.931571 7072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:34.931746 7072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:34.936188 7072 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:40587
I20260811 16:47:34.936240 7188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:40587 every 8 connection(s)
I20260811 16:47:34.936633 7072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:34.937911 7189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:34.940208 7189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5: Bootstrap starting.
I20260811 16:47:34.940781 7189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:34.941116 7189 log.cc:824] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:34.941828 7189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5: No bootstrap required, opened a new log
I20260811 16:47:34.943457 7189 raft_consensus.cc:348] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d242f848eca4489cac97c694f04936a5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40587 } }
I20260811 16:47:34.943602 7189 raft_consensus.cc:374] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:34.943625 7189 raft_consensus.cc:729] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d242f848eca4489cac97c694f04936a5, State: Initialized, Role: FOLLOWER
I20260811 16:47:34.943773 7189 consensus_queue.cc:260] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d242f848eca4489cac97c694f04936a5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40587 } }
I20260811 16:47:34.943866 7189 raft_consensus.cc:388] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:34.943902 7189 raft_consensus.cc:482] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:34.943950 7189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:34.943938 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 7072
I20260811 16:47:34.944033 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:34.944227 2270 external_mini_cluster.cc:1428] Setting key f2443062216a174fb026ebbf3f1e66b4
I20260811 16:47:34.945178 7189 raft_consensus.cc:504] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d242f848eca4489cac97c694f04936a5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40587 } }
I20260811 16:47:34.945293 7189 leader_election.cc:302] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d242f848eca4489cac97c694f04936a5; no voters:
I20260811 16:47:34.945444 7189 leader_election.cc:288] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:34.945513 7201 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:34.945729 7201 raft_consensus.cc:686] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [term 1 LEADER]: Becoming Leader. State: Replica: d242f848eca4489cac97c694f04936a5, State: Running, Role: LEADER
I20260811 16:47:34.945732 7189 sys_catalog.cc:564] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:34.945930 7201 consensus_queue.cc:237] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d242f848eca4489cac97c694f04936a5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40587 } }
I20260811 16:47:34.946924 7202 sys_catalog.cc:455] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d242f848eca4489cac97c694f04936a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d242f848eca4489cac97c694f04936a5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40587 } } }
I20260811 16:47:34.947197 7202 sys_catalog.cc:458] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:34.947801 7218 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:34.947949 7204 sys_catalog.cc:455] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d242f848eca4489cac97c694f04936a5. Latest consensus state: current_term: 1 leader_uuid: "d242f848eca4489cac97c694f04936a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d242f848eca4489cac97c694f04936a5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40587 } } }
I20260811 16:47:34.948140 7204 sys_catalog.cc:458] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:34.948374 7218 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:34.950354 7218 catalog_manager.cc:1347] Generated new cluster ID: faeeeb8a204842c0bf974d7a1b80b474
I20260811 16:47:34.950414 7218 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:47:34 dist-test-slave-3h5h krb5kdc[7056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:34.957201 7199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:34.944914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35890 (local address 127.2.55.190:40587)
0811 16:47:34.945161 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:34.945172 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:34.945210 (+ 38us) server_negotiation.cc:407] Connection header received
0811 16:47:34.945335 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:34.945343 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:34.945407 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:34.946410 (+ 1003us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:34.946541 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:34.948394 (+ 1853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:34.949556 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:34.950115 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:34.950226 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:34.953157 (+ 2931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:34.953162 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:34.953163 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:34.953176 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:34.955291 (+ 2115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:34.955768 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:34.955771 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:34.955771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:34.955892 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:34.956166 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:34.956166 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:34.956167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:34.956474 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:34.956630 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:34.956783 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 16:47:34.956948 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":128,"threads_started":1}
I20260811 16:47:34.969168 7218 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:34.969766 7218 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:34.974318 7218 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d242f848eca4489cac97c694f04936a5: Generated new TSK 0
I20260811 16:47:34.974522 7218 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:47:35.007740 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40587
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:46149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:35.093637 7238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:35.093865 7238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:35.093889 7238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:35.095132 7238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:35.095196 7238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:35.095229 7238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:47:35.097283 7238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:46149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:35.097572 7238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:35.097841 7238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:35.103842 7256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:35.103897 7251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:35.103817 7249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:35.104234 7238 server_base.cc:1034] running on GCE node
I20260811 16:47:35.104398 7238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:35.104607 7238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:35.105782 7238 hybrid_clock.cc:648] HybridClock initialized: now 1786466855105768 us; error 42 us; skew 500 ppm
Aug 11 16:47:35 dist-test-slave-3h5h krb5kdc[7056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466855, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:35.108431 7238 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:47:35.109050 7238 webserver.cc:460] Webserver started at http://127.2.55.129:45579/ using document root <none> and password file <none>
I20260811 16:47:35.109328 7238 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:35.109404 7238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:35.109566 7238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:35.110652 7238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "8c16cd4d964741109dc2166e12eaf3e6"
format_stamp: "Formatted at 2026-08-11 16:47:35 on dist-test-slave-3h5h"
server_key: "0b3dd55f1f917c74e74546ff7931f5e5"
server_key_iv: "04ec38ba923e929c6d2357be5646c4f3"
server_key_version: "encryptionkey@0"
I20260811 16:47:35.111024 7238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "8c16cd4d964741109dc2166e12eaf3e6"
format_stamp: "Formatted at 2026-08-11 16:47:35 on dist-test-slave-3h5h"
server_key: "0b3dd55f1f917c74e74546ff7931f5e5"
server_key_iv: "04ec38ba923e929c6d2357be5646c4f3"
server_key_version: "encryptionkey@0"
I20260811 16:47:35.112438 7238 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:35.113561 7265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:35.113754 7238 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:47:35.113860 7238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "8c16cd4d964741109dc2166e12eaf3e6"
format_stamp: "Formatted at 2026-08-11 16:47:35 on dist-test-slave-3h5h"
server_key: "0b3dd55f1f917c74e74546ff7931f5e5"
server_key_iv: "04ec38ba923e929c6d2357be5646c4f3"
server_key_version: "encryptionkey@0"
I20260811 16:47:35.113955 7238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:35.140971 7238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:35.143287 7238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:35.143541 7238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:35.143831 7238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:35.144200 7238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:35.144263 7238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:35.144313 7238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:35.144349 7238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:35.151476 7238 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:46207
I20260811 16:47:35.151556 7447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:46207 every 8 connection(s)
I20260811 16:47:35.151898 7238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:47:35.154242 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 7238
I20260811 16:47:35.154327 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:47:35.154525 2270 external_mini_cluster.cc:1428] Setting key 2117ff7535bb565ecd6f6cd5531bdfcf
Aug 11 16:47:35 dist-test-slave-3h5h krb5kdc[7056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466855, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:35.163398 7199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:35.152873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:54277 (local address 127.2.55.190:40587)
0811 16:47:35.152934 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:35.152936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:35.153277 (+ 341us) server_negotiation.cc:407] Connection header received
0811 16:47:35.153874 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:35.153876 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:35.153896 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:35.153956 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:35.155203 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:35.155757 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:35.156997 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:35.157221 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:35.157287 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:35.160146 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:35.160148 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:35.160148 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:35.160156 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:35.161727 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:35.162297 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:35.162298 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:35.162299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:35.162354 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:35.162661 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:35.162662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:35.162662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:35.162774 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:35.162827 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:35.163235 (+ 408us) server_negotiation.cc:299] Negotiation successful
0811 16:47:35.163321 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:47:35.163707 7452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:35.152846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:40587 (local address 127.2.55.129:54277)
0811 16:47:35.153137 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:35.153180 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:35.153760 (+ 580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:35.154044 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:35.154048 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:35.154859 (+ 811us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:35.155093 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:35.155099 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:35.155864 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:35.155865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:35.156819 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:35.156823 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:35.157316 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:35.157317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:35.157487 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:35.158099 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:35.158112 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:35.160020 (+ 1908us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:35.161816 (+ 1796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:35.161825 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:35.161828 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:35.162199 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:35.162426 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:35.162427 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:35.162427 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:35.162587 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:35.162844 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:35.162852 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:35.163063 (+ 211us) client_negotiation.cc:769] Sending connection context
0811 16:47:35.163211 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 16:47:35.163415 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":86,"threads_started":1}
I20260811 16:47:35.164357 7450 heartbeater.cc:347] Connected to a master server at 127.2.55.190:40587
I20260811 16:47:35.164486 7450 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:35.164719 7450 heartbeater.cc:511] Master 127.2.55.190:40587 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
I20260811 16:47:35.165354 7130 ts_manager.cc:194] Registered new tserver with Master: 8c16cd4d964741109dc2166e12eaf3e6 (127.2.55.129:46207)
I20260811 16:47:35.165938 7130 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:54277
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:47:35.184252 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40587
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:46149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:35.268213 7455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:35.268478 7455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:35.268517 7455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:35.269681 7455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:35.269759 7455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:35.269805 7455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:47:35.271301 7455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:46149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:35.271587 7455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:35.271823 7455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:35.277390 7467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:35.277397 7470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:35.277390 7463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:35.277722 7455 server_base.cc:1034] running on GCE node
I20260811 16:47:35.277997 7455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:35.278266 7455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:35.279414 7455 hybrid_clock.cc:648] HybridClock initialized: now 1786466855279393 us; error 37 us; skew 500 ppm
Aug 11 16:47:35 dist-test-slave-3h5h krb5kdc[7056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466855, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:35.282016 7455 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:47:35.282480 7455 webserver.cc:460] Webserver started at http://127.2.55.130:38077/ using document root <none> and password file <none>
I20260811 16:47:35.282666 7455 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:35.282706 7455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:35.282795 7455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:35.283798 7455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "ea2756dbd4fa44f5b17df7d2cde7a55d"
format_stamp: "Formatted at 2026-08-11 16:47:35 on dist-test-slave-3h5h"
server_key: "59f90b50848a08684184cdf3ccac2665"
server_key_iv: "12c2c6445f9df6b653be2088ef5bdae2"
server_key_version: "encryptionkey@0"
I20260811 16:47:35.284096 7455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "ea2756dbd4fa44f5b17df7d2cde7a55d"
format_stamp: "Formatted at 2026-08-11 16:47:35 on dist-test-slave-3h5h"
server_key: "59f90b50848a08684184cdf3ccac2665"
server_key_iv: "12c2c6445f9df6b653be2088ef5bdae2"
server_key_version: "encryptionkey@0"
I20260811 16:47:35.285513 7455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:35.286298 7489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:35.286598 7455 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:35.286725 7455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "ea2756dbd4fa44f5b17df7d2cde7a55d"
format_stamp: "Formatted at 2026-08-11 16:47:35 on dist-test-slave-3h5h"
server_key: "59f90b50848a08684184cdf3ccac2665"
server_key_iv: "12c2c6445f9df6b653be2088ef5bdae2"
server_key_version: "encryptionkey@0"
I20260811 16:47:35.286777 7455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:35.295866 7455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:35.298331 7455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:35.298506 7455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:35.298777 7455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:35.299219 7455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:35.299265 7455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:35.299309 7455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:35.299335 7455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:35.307029 7455 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:35521
I20260811 16:47:35.307070 7665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:35521 every 8 connection(s)
I20260811 16:47:35.307423 7455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:47:35.309978 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 7455
I20260811 16:47:35.310092 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:47:35.310295 2270 external_mini_cluster.cc:1428] Setting key 73d3217aaea022426baee7d9e6860c4f
Aug 11 16:47:35 dist-test-slave-3h5h krb5kdc[7056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466855, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:35.317924 7199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:35.308179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:58059 (local address 127.2.55.190:40587)
0811 16:47:35.308246 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:35.308248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:35.308452 (+ 204us) server_negotiation.cc:407] Connection header received
0811 16:47:35.309043 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:35.309045 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:35.309059 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:35.309119 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:35.310137 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:35.310774 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:35.311802 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:35.312015 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:35.312095 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:35.314547 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:35.314549 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:35.314550 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:35.314558 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:35.316241 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:35.316744 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:35.316746 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:35.316747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:35.316818 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:35.317178 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:35.317179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:35.317179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:35.317323 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:35.317413 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:35.317729 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 16:47:35.317822 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 16:47:35.318205 7670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:35.308163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:40587 (local address 127.2.55.130:58059)
0811 16:47:35.308330 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:35.308366 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:35.308936 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:35.309191 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:35.309195 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:35.309777 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:35.309965 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:35.309970 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:35.310869 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:35.310870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:35.311693 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:35.311696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:35.312101 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:35.312102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:35.312228 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:35.312801 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:35.312812 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:35.314453 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:35.316349 (+ 1896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:35.316356 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:35.316358 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:35.316610 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:35.316927 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:35.316929 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:35.316929 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:35.317088 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:35.317417 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:35.317425 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:35.317578 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 16:47:35.317704 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 16:47:35.317879 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":78,"threads_started":1}
I20260811 16:47:35.318799 7667 heartbeater.cc:347] Connected to a master server at 127.2.55.190:40587
I20260811 16:47:35.318908 7667 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:35.319113 7667 heartbeater.cc:511] Master 127.2.55.190:40587 requested a full tablet report, sending...
I20260811 16:47:35.319581 7130 ts_manager.cc:194] Registered new tserver with Master: ea2756dbd4fa44f5b17df7d2cde7a55d (127.2.55.130:35521)
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
I20260811 16:47:35.320036 7130 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:58059
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:47:35.340085 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40587
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:46149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:35.423028 7673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:35.423240 7673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:35.423264 7673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:35.424353 7673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:35.424388 7673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:35.424414 7673 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:47:35.425951 7673 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:46149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7673
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:35.426165 7673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:35.426353 7673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:35.431686 7679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:35.431694 7683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:35.431811 7673 server_base.cc:1034] running on GCE node
W20260811 16:47:35.431890 7680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:35.432243 7673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:35.432497 7673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:35.433684 7673 hybrid_clock.cc:648] HybridClock initialized: now 1786466855433660 us; error 39 us; skew 500 ppm
Aug 11 16:47:35 dist-test-slave-3h5h krb5kdc[7056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466855, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:35.436491 7673 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:47:35.436988 7673 webserver.cc:460] Webserver started at http://127.2.55.131:44255/ using document root <none> and password file <none>
I20260811 16:47:35.437274 7673 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:35.437347 7673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:35.437497 7673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:35.438575 7673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "2f3f4fe634174404b33df8c1bf4d63ac"
format_stamp: "Formatted at 2026-08-11 16:47:35 on dist-test-slave-3h5h"
server_key: "a8c99e78b9ae9ce3e2e3e828cab78b16"
server_key_iv: "3651fdcce61736af8e71e17c88fed426"
server_key_version: "encryptionkey@0"
I20260811 16:47:35.438937 7673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "2f3f4fe634174404b33df8c1bf4d63ac"
format_stamp: "Formatted at 2026-08-11 16:47:35 on dist-test-slave-3h5h"
server_key: "a8c99e78b9ae9ce3e2e3e828cab78b16"
server_key_iv: "3651fdcce61736af8e71e17c88fed426"
server_key_version: "encryptionkey@0"
I20260811 16:47:35.440297 7673 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:35.441128 7697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:35.441306 7673 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:35.441414 7673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "2f3f4fe634174404b33df8c1bf4d63ac"
format_stamp: "Formatted at 2026-08-11 16:47:35 on dist-test-slave-3h5h"
server_key: "a8c99e78b9ae9ce3e2e3e828cab78b16"
server_key_iv: "3651fdcce61736af8e71e17c88fed426"
server_key_version: "encryptionkey@0"
I20260811 16:47:35.441488 7673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:35.451355 7673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:35.453415 7673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:35.453593 7673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:35.453837 7673 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:35.454173 7673 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:35.454241 7673 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:35.454282 7673 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:35.454310 7673 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:35.460530 7673 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:32827
I20260811 16:47:35.460579 7878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:32827 every 8 connection(s)
I20260811 16:47:35.461112 7673 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:47:35.465633 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 7673
I20260811 16:47:35.465755 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:47:35.465945 2270 external_mini_cluster.cc:1428] Setting key 82e3b4529384b6c9c8c9c202e09da13c
Aug 11 16:47:35 dist-test-slave-3h5h krb5kdc[7056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466855, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:35.471231 7199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:35.461907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:42827 (local address 127.2.55.190:40587)
0811 16:47:35.461979 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:35.461982 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:35.462222 (+ 240us) server_negotiation.cc:407] Connection header received
0811 16:47:35.462743 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:35.462745 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:35.462757 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:35.462825 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:35.463995 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:35.464578 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:35.465733 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:35.466102 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:35.466190 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:35.468591 (+ 2401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:35.468592 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:35.468593 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:35.468601 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:35.470002 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:35.470389 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:35.470390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:35.470391 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:35.470446 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:35.470698 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:35.470699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:35.470699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:35.470802 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:35.470858 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:35.471099 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 16:47:35.471164 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 16:47:35.471462 7884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:35.461882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:40587 (local address 127.2.55.131:42827)
0811 16:47:35.462053 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:35.462105 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:35.462614 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:35.462935 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:35.462938 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:35.463631 (+ 693us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:35.463858 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:35.463864 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:35.464689 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:35.464690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:35.465624 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:35.465627 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:35.466197 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:35.466198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:35.466351 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:35.466960 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:35.466968 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:35.468478 (+ 1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:35.470085 (+ 1607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:35.470092 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:35.470093 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:35.470319 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:35.470531 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:35.470532 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:35.470532 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:35.470640 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:35.470860 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:35.470865 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:35.470983 (+ 118us) client_negotiation.cc:769] Sending connection context
0811 16:47:35.471070 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 16:47:35.471196 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":173,"threads_started":1}
I20260811 16:47:35.471971 7880 heartbeater.cc:347] Connected to a master server at 127.2.55.190:40587
I20260811 16:47:35.472146 7880 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:35.472359 7880 heartbeater.cc:511] Master 127.2.55.190:40587 requested a full tablet report, sending...
I20260811 16:47:35.472765 7130 ts_manager.cc:194] Registered new tserver with Master: 2f3f4fe634174404b33df8c1bf4d63ac (127.2.55.131:32827)
I20260811 16:47:35.473179 7130 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:42827
I20260811 16:47:35.477898 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 16:47:35 dist-test-slave-3h5h krb5kdc[7056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466855, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 16:47:35 dist-test-slave-3h5h krb5kdc[7056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466855, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:35.503448 7199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:35.495797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35898 (local address 127.2.55.190:40587)
0811 16:47:35.495873 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:35.495876 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:35.495981 (+ 105us) server_negotiation.cc:407] Connection header received
0811 16:47:35.496137 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:35.496138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:35.496157 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:35.496225 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:35.496830 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:35.497386 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:35.498130 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:35.498331 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:35.498407 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:35.500788 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:35.500790 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:35.500791 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:35.500799 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:35.502222 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:35.502585 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:35.502586 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:35.502586 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:35.502648 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:35.502849 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:35.502850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:35.502850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:35.503014 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:35.503128 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:35.503248 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 16:47:35.503336 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260811 16:47:35.503707 7130 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:35898
I20260811 16:47:35.504431 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 7238
I20260811 16:47:35.517143 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 7455
I20260811 16:47:35.542313 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 7673
I20260811 16:47:35.551884 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 7072
2026-08-11T16:47:35Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2154 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:47:35 dist-test-slave-3h5h krb5kdc[7914](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:47:35 dist-test-slave-3h5h krb5kdc[7914](info): set up 2 sockets
Aug 11 16:47:35 dist-test-slave-3h5h krb5kdc[7914](info): commencing operation
krb5kdc: starting...
W20260811 16:47:36.837862 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:47:36 dist-test-slave-3h5h krb5kdc[7914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466856, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:47:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:47:36.973151 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:33565
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:40789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:33565
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:37.059290 7940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:37.059552 7940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:37.059605 7940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:37.060807 7940 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:37.060905 7940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:37.060932 7940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:37.060945 7940 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:37.060957 7940 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:37.062515 7940 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:40789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:33565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:33565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:37.062732 7940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:37.062918 7940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:37.068203 7955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:37.068217 7947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:37.068317 7940 server_base.cc:1034] running on GCE node
W20260811 16:47:37.068255 7946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:37.068687 7940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:37.069021 7940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:37.070199 7940 hybrid_clock.cc:648] HybridClock initialized: now 1786466857070177 us; error 42 us; skew 500 ppm
Aug 11 16:47:37 dist-test-slave-3h5h krb5kdc[7914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466857, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:37.073014 7940 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:47:37.073506 7940 webserver.cc:460] Webserver started at http://127.2.55.190:35935/ using document root <none> and password file <none>
I20260811 16:47:37.073788 7940 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:37.073858 7940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:37.074013 7940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:37.075124 7940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "8a44f8d8bf514034905d86e6fd1abf46"
format_stamp: "Formatted at 2026-08-11 16:47:37 on dist-test-slave-3h5h"
server_key: "613ecdadec3bb24d7162656d8a247784"
server_key_iv: "8e3f420fc9badc53d58e56060a167d8c"
server_key_version: "encryptionkey@0"
I20260811 16:47:37.075495 7940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "8a44f8d8bf514034905d86e6fd1abf46"
format_stamp: "Formatted at 2026-08-11 16:47:37 on dist-test-slave-3h5h"
server_key: "613ecdadec3bb24d7162656d8a247784"
server_key_iv: "8e3f420fc9badc53d58e56060a167d8c"
server_key_version: "encryptionkey@0"
I20260811 16:47:37.076967 7940 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:37.077832 7971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:37.078155 7940 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:37.078279 7940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "8a44f8d8bf514034905d86e6fd1abf46"
format_stamp: "Formatted at 2026-08-11 16:47:37 on dist-test-slave-3h5h"
server_key: "613ecdadec3bb24d7162656d8a247784"
server_key_iv: "8e3f420fc9badc53d58e56060a167d8c"
server_key_version: "encryptionkey@0"
I20260811 16:47:37.078382 7940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:37.095450 7940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:37.097960 7940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:37.098166 7940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:37.103086 7940 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:33565
I20260811 16:47:37.103144 8051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:33565 every 8 connection(s)
I20260811 16:47:37.103811 7940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:37.104548 8055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:37.107060 8055 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46: Bootstrap starting.
I20260811 16:47:37.107728 8055 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:37.108053 8055 log.cc:824] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:37.108904 8055 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46: No bootstrap required, opened a new log
I20260811 16:47:37.109359 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 7940
I20260811 16:47:37.109504 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:37.109727 2270 external_mini_cluster.cc:1428] Setting key 4b14e787c61198675b484f47a00e5dae
I20260811 16:47:37.111833 8055 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a44f8d8bf514034905d86e6fd1abf46" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 33565 } }
I20260811 16:47:37.112015 8055 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:37.112056 8055 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a44f8d8bf514034905d86e6fd1abf46, State: Initialized, Role: FOLLOWER
I20260811 16:47:37.112181 8055 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a44f8d8bf514034905d86e6fd1abf46" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 33565 } }
I20260811 16:47:37.112267 8055 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:37.112289 8055 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:37.112360 8055 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:37.113103 8055 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a44f8d8bf514034905d86e6fd1abf46" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 33565 } }
I20260811 16:47:37.113219 8055 leader_election.cc:302] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a44f8d8bf514034905d86e6fd1abf46; no voters:
I20260811 16:47:37.113422 8055 leader_election.cc:288] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:37.113581 8062 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:37.113718 8055 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:37.113890 8062 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [term 1 LEADER]: Becoming Leader. State: Replica: 8a44f8d8bf514034905d86e6fd1abf46, State: Running, Role: LEADER
I20260811 16:47:37.114179 8062 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a44f8d8bf514034905d86e6fd1abf46" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 33565 } }
I20260811 16:47:37.114750 8065 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a44f8d8bf514034905d86e6fd1abf46. Latest consensus state: current_term: 1 leader_uuid: "8a44f8d8bf514034905d86e6fd1abf46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a44f8d8bf514034905d86e6fd1abf46" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 33565 } } }
I20260811 16:47:37.114848 8065 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:37.115060 8064 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a44f8d8bf514034905d86e6fd1abf46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a44f8d8bf514034905d86e6fd1abf46" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 33565 } } }
I20260811 16:47:37.115159 8064 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:37.115279 8075 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:37.115883 8075 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:37.117794 8075 catalog_manager.cc:1347] Generated new cluster ID: 70dd5620ee8646698ee68539ea4e5590
I20260811 16:47:37.117856 8075 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:47:37 dist-test-slave-3h5h krb5kdc[7914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466856, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:37.122721 8061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:37.110354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55444 (local address 127.2.55.190:33565)
0811 16:47:37.110573 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:37.110583 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:37.110621 (+ 38us) server_negotiation.cc:407] Connection header received
0811 16:47:37.111790 (+ 1169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:37.111800 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:37.111870 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:37.112030 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:37.112893 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.114369 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.115569 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.116306 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.116442 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:37.119210 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:37.119214 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:37.119215 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:37.119227 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:37.121069 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:37.121451 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:37.121455 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:37.121455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:37.121568 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:37.121801 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:37.121802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:37.121802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:37.122050 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:37.122244 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:37.122312 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 16:47:37.122564 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":92,"threads_started":1}
I20260811 16:47:37.143882 8075 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:37.144696 8075 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:37.161957 8075 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a44f8d8bf514034905d86e6fd1abf46: Generated new TSK 0
I20260811 16:47:37.162199 8075 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:47:37.205274 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:33565
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:40789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:37.292393 8094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:37.292613 8094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:37.292637 8094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:37.293905 8094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:37.293952 8094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:37.293980 8094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:47:37.295534 8094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:40789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:33565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:37.295817 8094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:37.296124 8094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:37.302415 8104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:37.302421 8108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:37.302840 8105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:37.303423 8094 server_base.cc:1034] running on GCE node
I20260811 16:47:37.303709 8094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:37.304070 8094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:37.305248 8094 hybrid_clock.cc:648] HybridClock initialized: now 1786466857305236 us; error 36 us; skew 500 ppm
Aug 11 16:47:37 dist-test-slave-3h5h krb5kdc[7914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466857, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:37.308151 8094 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:47:37.308601 8094 webserver.cc:460] Webserver started at http://127.2.55.129:42279/ using document root <none> and password file <none>
I20260811 16:47:37.308791 8094 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:37.308880 8094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:37.309010 8094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:37.310047 8094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "4dbc8d4dccfa447fa56003bb9ee34356"
format_stamp: "Formatted at 2026-08-11 16:47:37 on dist-test-slave-3h5h"
server_key: "143be1b5e45b1612fd76912a1f512e7d"
server_key_iv: "25a5e23a9b5d271808400527dc396e7e"
server_key_version: "encryptionkey@0"
I20260811 16:47:37.310356 8094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "4dbc8d4dccfa447fa56003bb9ee34356"
format_stamp: "Formatted at 2026-08-11 16:47:37 on dist-test-slave-3h5h"
server_key: "143be1b5e45b1612fd76912a1f512e7d"
server_key_iv: "25a5e23a9b5d271808400527dc396e7e"
server_key_version: "encryptionkey@0"
I20260811 16:47:37.311779 8094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:47:37.312587 8120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:37.312773 8094 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:37.312907 8094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "4dbc8d4dccfa447fa56003bb9ee34356"
format_stamp: "Formatted at 2026-08-11 16:47:37 on dist-test-slave-3h5h"
server_key: "143be1b5e45b1612fd76912a1f512e7d"
server_key_iv: "25a5e23a9b5d271808400527dc396e7e"
server_key_version: "encryptionkey@0"
I20260811 16:47:37.312978 8094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:37.344434 8094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:37.346935 8094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:37.347131 8094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:37.347359 8094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:37.347649 8094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:37.347681 8094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:37.347704 8094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:37.347716 8094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:37.354127 8094 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:43163
I20260811 16:47:37.354230 8298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:43163 every 8 connection(s)
I20260811 16:47:37.354559 8094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:47:37 dist-test-slave-3h5h krb5kdc[7914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466857, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:37.362361 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 8094
I20260811 16:47:37.362476 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:47:37.362687 2270 external_mini_cluster.cc:1428] Setting key 3e11cb9fce713c38d75cbb00357b0457
I20260811 16:47:37.365546 8061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:37.355341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:38215 (local address 127.2.55.190:33565)
0811 16:47:37.355410 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:37.355412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:37.355672 (+ 260us) server_negotiation.cc:407] Connection header received
0811 16:47:37.356618 (+ 946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:37.356620 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:37.356631 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:37.356696 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:37.357495 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.358087 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.359373 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.359737 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.359807 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:37.362110 (+ 2303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:37.362112 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:37.362112 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:37.362119 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:37.363751 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:37.364254 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:37.364255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:37.364256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:37.364321 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:37.364642 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:37.364643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:37.364644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:37.364777 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:37.364920 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:37.365269 (+ 349us) server_negotiation.cc:299] Negotiation successful
0811 16:47:37.365383 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:47:37.365731 8301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:37.355309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:33565 (local address 127.2.55.129:38215)
0811 16:47:37.355530 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:37.355576 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:37.356503 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:37.356796 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:37.356800 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:37.357177 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:37.357384 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:37.357389 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.358186 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.358187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:37.359262 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:37.359265 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.359828 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.359829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:37.359936 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:37.360521 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:37.360530 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:37.361980 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:37.363831 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:37.363839 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:37.363842 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:37.364172 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:37.364391 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:37.364391 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:37.364392 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:37.364547 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:37.364924 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:37.364930 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:37.365114 (+ 184us) client_negotiation.cc:769] Sending connection context
0811 16:47:37.365244 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 16:47:37.365438 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":118,"threads_started":1}
I20260811 16:47:37.366315 8299 heartbeater.cc:347] Connected to a master server at 127.2.55.190:33565
I20260811 16:47:37.366437 8299 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:37.366627 8299 heartbeater.cc:511] Master 127.2.55.190:33565 requested a full tablet report, sending...
I20260811 16:47:37.367256 7997 ts_manager.cc:194] Registered new tserver with Master: 4dbc8d4dccfa447fa56003bb9ee34356 (127.2.55.129:43163)
I20260811 16:47:37.367880 7997 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:38215
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:47:37.392812 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:33565
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:40789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:37.476447 8306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:37.476722 8306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:37.476763 8306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:37.478132 8306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:37.478210 8306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:37.478256 8306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:47:37.479808 8306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:40789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:33565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:37.480082 8306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:37.480319 8306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:37.486184 8323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:37.486186 8313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:37.486287 8312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:37.486614 8306 server_base.cc:1034] running on GCE node
I20260811 16:47:37.486819 8306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:37.487007 8306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:37.488185 8306 hybrid_clock.cc:648] HybridClock initialized: now 1786466857488167 us; error 26 us; skew 500 ppm
Aug 11 16:47:37 dist-test-slave-3h5h krb5kdc[7914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466857, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:37.490916 8306 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:47:37.491469 8306 webserver.cc:460] Webserver started at http://127.2.55.130:46701/ using document root <none> and password file <none>
I20260811 16:47:37.491722 8306 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:37.491801 8306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:37.491966 8306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:37.493234 8306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "89dbb93b6b6a4109a924d38209c7eddb"
format_stamp: "Formatted at 2026-08-11 16:47:37 on dist-test-slave-3h5h"
server_key: "a017807c2ff2b1589bd1c4cc15880b74"
server_key_iv: "b40247368d55e96d495b18fcc786bce9"
server_key_version: "encryptionkey@0"
I20260811 16:47:37.493654 8306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "89dbb93b6b6a4109a924d38209c7eddb"
format_stamp: "Formatted at 2026-08-11 16:47:37 on dist-test-slave-3h5h"
server_key: "a017807c2ff2b1589bd1c4cc15880b74"
server_key_iv: "b40247368d55e96d495b18fcc786bce9"
server_key_version: "encryptionkey@0"
I20260811 16:47:37.495169 8306 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:47:37.496080 8333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:37.496295 8306 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:37.496415 8306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "89dbb93b6b6a4109a924d38209c7eddb"
format_stamp: "Formatted at 2026-08-11 16:47:37 on dist-test-slave-3h5h"
server_key: "a017807c2ff2b1589bd1c4cc15880b74"
server_key_iv: "b40247368d55e96d495b18fcc786bce9"
server_key_version: "encryptionkey@0"
I20260811 16:47:37.496500 8306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:37.511484 8306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:37.513783 8306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:37.513949 8306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:37.514212 8306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:37.514622 8306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:37.514676 8306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:37.514720 8306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:37.514747 8306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:37.521003 8306 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:36101
I20260811 16:47:37.521070 8525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:36101 every 8 connection(s)
I20260811 16:47:37.521381 8306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:47:37 dist-test-slave-3h5h krb5kdc[7914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466857, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:37.528826 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 8306
I20260811 16:47:37.529004 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:47:37.529332 2270 external_mini_cluster.cc:1428] Setting key 8a3daa5605d89b72b1fbeee63fa2215e
I20260811 16:47:37.532312 8061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:37.522191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:58403 (local address 127.2.55.190:33565)
0811 16:47:37.522266 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:37.522269 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:37.522539 (+ 270us) server_negotiation.cc:407] Connection header received
0811 16:47:37.523633 (+ 1094us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:37.523635 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:37.523646 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:37.523711 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:37.524433 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.525066 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.526086 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.526374 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.526434 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:37.529115 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:37.529116 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:37.529116 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:37.529128 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:37.530832 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:37.531302 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:37.531303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:37.531304 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:37.531371 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:37.531635 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:37.531636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:37.531637 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:37.531760 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:37.531839 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:37.532124 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 16:47:37.532217 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:47:37.532558 8528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:37.522172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:33565 (local address 127.2.55.130:58403)
0811 16:47:37.522404 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:37.522446 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:37.523503 (+ 1057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:37.523799 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:37.523803 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:37.524090 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:37.524293 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:37.524297 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.525172 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.525174 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:37.526005 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:37.526007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.526474 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.526475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:37.526629 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:37.527319 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:37.527329 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:37.529003 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:37.530940 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:37.530948 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:37.530950 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:37.531215 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:37.531444 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:37.531445 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:37.531445 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:37.531562 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:37.531830 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:37.531838 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:37.531985 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 16:47:37.532102 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 16:47:37.532277 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":117,"threads_started":1}
I20260811 16:47:37.533078 8526 heartbeater.cc:347] Connected to a master server at 127.2.55.190:33565
I20260811 16:47:37.533196 8526 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:37.533390 8526 heartbeater.cc:511] Master 127.2.55.190:33565 requested a full tablet report, sending...
I20260811 16:47:37.533840 7997 ts_manager.cc:194] Registered new tserver with Master: 89dbb93b6b6a4109a924d38209c7eddb (127.2.55.130:36101)
I20260811 16:47:37.534380 7997 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:58403
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:47:37.560580 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:33565
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:40789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:37.654289 8531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:37.654515 8531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:37.654541 8531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:37.655661 8531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:37.655704 8531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:37.655733 8531 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:47:37.657344 8531 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:40789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:33565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:37.657544 8531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:37.657728 8531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:37.663067 8541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:37.663188 8543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:37.663264 8540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:37.663547 8531 server_base.cc:1034] running on GCE node
I20260811 16:47:37.663782 8531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:37.664058 8531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:37.665248 8531 hybrid_clock.cc:648] HybridClock initialized: now 1786466857665235 us; error 31 us; skew 500 ppm
Aug 11 16:47:37 dist-test-slave-3h5h krb5kdc[7914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466857, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:37.668007 8531 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:47:37.668470 8531 webserver.cc:460] Webserver started at http://127.2.55.131:36103/ using document root <none> and password file <none>
I20260811 16:47:37.668669 8531 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:37.668711 8531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:37.668802 8531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:37.669886 8531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "19fa618567ed443cb2da3038edfba648"
format_stamp: "Formatted at 2026-08-11 16:47:37 on dist-test-slave-3h5h"
server_key: "cb74a21cfc0884ba6462aab06fe804e3"
server_key_iv: "8c3de193a14a7c042c5496a08f73ea7a"
server_key_version: "encryptionkey@0"
I20260811 16:47:37.670217 8531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "19fa618567ed443cb2da3038edfba648"
format_stamp: "Formatted at 2026-08-11 16:47:37 on dist-test-slave-3h5h"
server_key: "cb74a21cfc0884ba6462aab06fe804e3"
server_key_iv: "8c3de193a14a7c042c5496a08f73ea7a"
server_key_version: "encryptionkey@0"
I20260811 16:47:37.671567 8531 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:47:37.672322 8550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:37.672542 8531 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:37.672634 8531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "19fa618567ed443cb2da3038edfba648"
format_stamp: "Formatted at 2026-08-11 16:47:37 on dist-test-slave-3h5h"
server_key: "cb74a21cfc0884ba6462aab06fe804e3"
server_key_iv: "8c3de193a14a7c042c5496a08f73ea7a"
server_key_version: "encryptionkey@0"
I20260811 16:47:37.672689 8531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:37.690130 8531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:37.692399 8531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:37.692512 8531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:37.692711 8531 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:37.693001 8531 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:37.693034 8531 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:37.693056 8531 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:37.693069 8531 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:37.698810 8531 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:45493
I20260811 16:47:37.698889 8738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:45493 every 8 connection(s)
I20260811 16:47:37.699218 8531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:47:37 dist-test-slave-3h5h krb5kdc[7914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466857, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:37.707158 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 8531
I20260811 16:47:37.707247 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:47:37.707463 2270 external_mini_cluster.cc:1428] Setting key e15e8836d622ae904e48809a45c22ec9
I20260811 16:47:37.708889 8061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:37.700022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:44491 (local address 127.2.55.190:33565)
0811 16:47:37.700072 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:37.700074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:37.700287 (+ 213us) server_negotiation.cc:407] Connection header received
0811 16:47:37.701405 (+ 1118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:37.701406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:37.701419 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:37.701471 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:37.702181 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.702722 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.703702 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.703912 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.703999 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:37.706177 (+ 2178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:37.706178 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:37.706179 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:37.706185 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:37.707449 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:37.707852 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:37.707853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:37.707854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:37.707921 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:37.708232 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:37.708233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:37.708233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:37.708356 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:37.708429 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:37.708691 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 16:47:37.708772 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:47:37.709069 8741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:37.699986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:33565 (local address 127.2.55.131:44491)
0811 16:47:37.700167 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:37.700203 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:37.701291 (+ 1088us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:37.701540 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:37.701544 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:37.701809 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:37.701995 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:37.701998 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.702824 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.702825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:37.703611 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:37.703613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.704011 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.704012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:37.704138 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:37.704575 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:37.704583 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:37.706092 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:37.707530 (+ 1438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:37.707538 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:37.707541 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:37.707773 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:37.707994 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:37.707995 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:37.707995 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:37.708153 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:37.708431 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:37.708438 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:37.708560 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 16:47:37.708666 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 16:47:37.708821 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":90,"threads_started":1}
I20260811 16:47:37.709530 8739 heartbeater.cc:347] Connected to a master server at 127.2.55.190:33565
I20260811 16:47:37.709630 8739 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:37.709770 8739 heartbeater.cc:511] Master 127.2.55.190:33565 requested a full tablet report, sending...
I20260811 16:47:37.710136 7997 ts_manager.cc:194] Registered new tserver with Master: 19fa618567ed443cb2da3038edfba648 (127.2.55.131:45493)
I20260811 16:47:37.710461 7997 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:44491
I20260811 16:47:37.719202 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 16:47:37 dist-test-slave-3h5h krb5kdc[7914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 16:47:37 dist-test-slave-3h5h krb5kdc[7914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.129@KRBTEST.COM
I20260811 16:47:37.745100 8749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:37.736918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60990 (local address 127.2.55.129:43163)
0811 16:47:37.737103 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:37.737108 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:37.737121 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:47:37.737169 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:37.737171 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:37.737188 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:37.737265 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:37.737899 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.738616 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.739398 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.739739 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.739799 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:37.742370 (+ 2571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:37.742380 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:37.742380 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:37.742387 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:37.743878 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:37.744224 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:37.744227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:37.744228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:37.744285 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:37.744459 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:37.744459 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:37.744460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:37.744594 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:37.744702 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:37.744899 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 16:47:37.744969 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":95,"threads_started":1}
Aug 11 16:47:37 dist-test-slave-3h5h krb5kdc[7914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:37.753265 8061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:37.746632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55458 (local address 127.2.55.190:33565)
0811 16:47:37.746690 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:37.746692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:37.746701 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:37.746730 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:37.746731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:37.746740 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:37.746789 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:37.747232 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.747739 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.748399 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:37.748627 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:37.748681 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:37.750825 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:37.750827 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:37.750827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:37.750834 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:37.752219 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:37.752513 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:37.752514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:37.752514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:37.752580 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:37.752726 (+ 146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:37.752726 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:37.752727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:37.752923 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:37.752999 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:37.753141 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 16:47:37.753200 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260811 16:47:37.753544 7997 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55458
I20260811 16:47:37.753929 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 8094
I20260811 16:47:37.769431 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 8306
I20260811 16:47:37.778440 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 8531
I20260811 16:47:37.788166 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 7940
2026-08-11T16:47:37Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2236 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:47:37 dist-test-slave-3h5h krb5kdc[8761](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:47:37 dist-test-slave-3h5h krb5kdc[8761](info): set up 2 sockets
Aug 11 16:47:37 dist-test-slave-3h5h krb5kdc[8761](info): commencing operation
krb5kdc: starting...
W20260811 16:47:39.129006 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.315s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260811 16:47:39.356402 2270 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.227s user 0.001s sys 0.003s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260811 16:47:39.589500 2270 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.233s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260811 16:47:39.695063 2270 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.105s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/test-user.keytab.
W20260811 16:47:40.012624 2270 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.317s user 0.000s sys 0.002s
Aug 11 16:47:40 dist-test-slave-3h5h krb5kdc[8761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:47:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:47:40.064949 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:42589
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:44061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:42589
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:40.151384 8784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:40.151579 8784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:40.151602 8784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:40.152729 8784 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:40.152768 8784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:40.152782 8784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:40.152794 8784 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:40.152806 8784 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:40.154376 8784 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:42589
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:42589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:40.154678 8784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:40.154928 8784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:40.159958 8796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:40.159937 8793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:40.159937 8791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:40.160076 8784 server_base.cc:1034] running on GCE node
I20260811 16:47:40.160439 8784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:40.160698 8784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:40.161877 8784 hybrid_clock.cc:648] HybridClock initialized: now 1786466860161848 us; error 44 us; skew 500 ppm
Aug 11 16:47:40 dist-test-slave-3h5h krb5kdc[8761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466860, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:40.174830 8784 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:47:40.175308 8784 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:40.175395 8784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:40.175567 8784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:40.176736 8784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "783cff6a7f4c4374b277233990f2f90c"
format_stamp: "Formatted at 2026-08-11 16:47:40 on dist-test-slave-3h5h"
server_key: "8554704cb18efc0119ef4eadf47adaed"
server_key_iv: "65af12931ebe46c48e6d10c2ce919698"
server_key_version: "encryptionkey@0"
I20260811 16:47:40.177207 8784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "783cff6a7f4c4374b277233990f2f90c"
format_stamp: "Formatted at 2026-08-11 16:47:40 on dist-test-slave-3h5h"
server_key: "8554704cb18efc0119ef4eadf47adaed"
server_key_iv: "65af12931ebe46c48e6d10c2ce919698"
server_key_version: "encryptionkey@0"
I20260811 16:47:40.178740 8784 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:47:40.179639 8810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:40.179869 8784 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:40.179996 8784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "783cff6a7f4c4374b277233990f2f90c"
format_stamp: "Formatted at 2026-08-11 16:47:40 on dist-test-slave-3h5h"
server_key: "8554704cb18efc0119ef4eadf47adaed"
server_key_iv: "65af12931ebe46c48e6d10c2ce919698"
server_key_version: "encryptionkey@0"
I20260811 16:47:40.180109 8784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:40.194797 8784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:40.197181 8784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:40.197362 8784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:40.201900 8784 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:42589
I20260811 16:47:40.201936 8899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:42589 every 8 connection(s)
I20260811 16:47:40.202293 8784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:40.203495 8900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:40.206067 8900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c: Bootstrap starting.
I20260811 16:47:40.206727 8900 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:40.207047 8900 log.cc:824] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:40.207811 8900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c: No bootstrap required, opened a new log
I20260811 16:47:40.209600 8900 raft_consensus.cc:348] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "783cff6a7f4c4374b277233990f2f90c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42589 } }
I20260811 16:47:40.209741 8900 raft_consensus.cc:374] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:40.209764 8900 raft_consensus.cc:729] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 783cff6a7f4c4374b277233990f2f90c, State: Initialized, Role: FOLLOWER
I20260811 16:47:40.209928 8900 consensus_queue.cc:260] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "783cff6a7f4c4374b277233990f2f90c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42589 } }
I20260811 16:47:40.210007 8900 raft_consensus.cc:388] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:40.210031 8900 raft_consensus.cc:482] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:40.210060 8900 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:40.210922 8900 raft_consensus.cc:504] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "783cff6a7f4c4374b277233990f2f90c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42589 } }
I20260811 16:47:40.211050 8900 leader_election.cc:302] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 783cff6a7f4c4374b277233990f2f90c; no voters:
I20260811 16:47:40.211215 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 8784
I20260811 16:47:40.211264 8900 leader_election.cc:288] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:40.211306 8907 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:40.211344 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:40.211496 8907 raft_consensus.cc:686] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [term 1 LEADER]: Becoming Leader. State: Replica: 783cff6a7f4c4374b277233990f2f90c, State: Running, Role: LEADER
I20260811 16:47:40.211557 2270 external_mini_cluster.cc:1428] Setting key af7e5a669ba4d62b33c56487de50f0c7
I20260811 16:47:40.211561 8900 sys_catalog.cc:564] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:40.211649 8907 consensus_queue.cc:237] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "783cff6a7f4c4374b277233990f2f90c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42589 } }
I20260811 16:47:40.211983 8909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "783cff6a7f4c4374b277233990f2f90c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "783cff6a7f4c4374b277233990f2f90c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42589 } } }
I20260811 16:47:40.212112 8909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:40.212431 8910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 783cff6a7f4c4374b277233990f2f90c. Latest consensus state: current_term: 1 leader_uuid: "783cff6a7f4c4374b277233990f2f90c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "783cff6a7f4c4374b277233990f2f90c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42589 } } }
I20260811 16:47:40.212564 8920 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:40.212585 8910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:40.213238 8920 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:40.215348 8920 catalog_manager.cc:1347] Generated new cluster ID: 668de3d8188040c09c2553419165fce9
I20260811 16:47:40.215399 8920 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:47:40 dist-test-slave-3h5h krb5kdc[8761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:40.224215 8919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.212053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46672 (local address 127.2.55.190:42589)
0811 16:47:40.212416 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:40.212427 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:40.212468 (+ 41us) server_negotiation.cc:407] Connection header received
0811 16:47:40.212608 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:40.212617 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:40.212687 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:40.212865 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:40.213824 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.215542 (+ 1718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.216693 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.217366 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.217471 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.220339 (+ 2868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:40.220343 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:40.220344 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:40.220357 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:40.222452 (+ 2095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:40.222876 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:40.222880 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:40.222880 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:40.223017 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:40.223261 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:40.223262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:40.223262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:40.223586 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:40.223751 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:40.223826 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 16:47:40.223965 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":301,"thread_start_us":138,"threads_started":1}
I20260811 16:47:40.250615 8920 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:40.251227 8920 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:40.263605 8920 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c: Generated new TSK 0
I20260811 16:47:40.263862 8920 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:47:40.303455 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42589
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:44061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:40.389935 8942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:40.390128 8942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:40.390151 8942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:40.391220 8942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:40.391254 8942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:40.391280 8942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:47:40.392719 8942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42589
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:40.392966 8942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:40.393157 8942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:40.398458 8948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:40.398461 8954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:40.398458 8952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:40.398576 8942 server_base.cc:1034] running on GCE node
I20260811 16:47:40.398871 8942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:40.399116 8942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:40.400279 8942 hybrid_clock.cc:648] HybridClock initialized: now 1786466860400260 us; error 48 us; skew 500 ppm
Aug 11 16:47:40 dist-test-slave-3h5h krb5kdc[8761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466860, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:40.403112 8942 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:47:40.403488 8942 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:40.403544 8942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:40.403633 8942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:40.404667 8942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "e034beb33fca423bb23988fb0df43f94"
format_stamp: "Formatted at 2026-08-11 16:47:40 on dist-test-slave-3h5h"
server_key: "6bba7f74e3f38a85411dbfad3590942b"
server_key_iv: "0c84fd75e4394684ad15f05c611702ab"
server_key_version: "encryptionkey@0"
I20260811 16:47:40.405113 8942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "e034beb33fca423bb23988fb0df43f94"
format_stamp: "Formatted at 2026-08-11 16:47:40 on dist-test-slave-3h5h"
server_key: "6bba7f74e3f38a85411dbfad3590942b"
server_key_iv: "0c84fd75e4394684ad15f05c611702ab"
server_key_version: "encryptionkey@0"
I20260811 16:47:40.406533 8942 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:40.407388 8964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:40.407621 8942 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:40.407735 8942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "e034beb33fca423bb23988fb0df43f94"
format_stamp: "Formatted at 2026-08-11 16:47:40 on dist-test-slave-3h5h"
server_key: "6bba7f74e3f38a85411dbfad3590942b"
server_key_iv: "0c84fd75e4394684ad15f05c611702ab"
server_key_version: "encryptionkey@0"
I20260811 16:47:40.407811 8942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:40.420077 8942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:40.422642 8942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:40.422811 8942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:40.423062 8942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:40.423413 8942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:40.423468 8942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:40.423516 8942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:40.423553 8942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:40.429774 8942 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:36809
I20260811 16:47:40.429817 9157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:36809 every 8 connection(s)
I20260811 16:47:40.430127 8942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:47:40 dist-test-slave-3h5h krb5kdc[8761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466860, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:40.439769 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 8942
I20260811 16:47:40.439870 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:47:40.440147 2270 external_mini_cluster.cc:1428] Setting key 4190555ec9d9a0af6b3795871fbabe01
I20260811 16:47:40.441378 9163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.430995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:42589 (local address 127.2.55.129:54623)
0811 16:47:40.431258 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:40.431304 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:40.431803 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:40.432171 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:40.432175 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:40.432457 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:40.433121 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:40.433127 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.433988 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.433989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:40.434853 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:40.434856 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.435319 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.435320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:40.435427 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.435961 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:40.435970 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:40.437752 (+ 1782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:40.439619 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:40.439627 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:40.439630 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:40.439953 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:40.440214 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:40.440215 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:40.440215 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:40.440371 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:40.440711 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:40.440717 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:40.440920 (+ 203us) client_negotiation.cc:769] Sending connection context
0811 16:47:40.441051 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 16:47:40.441206 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":107,"threads_started":1}
I20260811 16:47:40.441371 8919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.431080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:54623 (local address 127.2.55.190:42589)
0811 16:47:40.431201 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:40.431203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:40.431437 (+ 234us) server_negotiation.cc:407] Connection header received
0811 16:47:40.431896 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:40.431897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:40.431913 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:40.431979 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:40.433263 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.433866 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.434957 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.435223 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.435297 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.437850 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:40.437852 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:40.437852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:40.437860 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:40.439493 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:40.440034 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:40.440035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:40.440035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:40.440133 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:40.440472 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:40.440474 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:40.440474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:40.440634 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:40.440704 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:40.441112 (+ 408us) server_negotiation.cc:299] Negotiation successful
0811 16:47:40.441222 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 16:47:40.442081 9158 heartbeater.cc:347] Connected to a master server at 127.2.55.190:42589
I20260811 16:47:40.442201 9158 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:40.442358 9158 heartbeater.cc:511] Master 127.2.55.190:42589 requested a full tablet report, sending...
I20260811 16:47:40.442943 8837 ts_manager.cc:194] Registered new tserver with Master: e034beb33fca423bb23988fb0df43f94 (127.2.55.129:36809)
I20260811 16:47:40.443923 8837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:54623
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:47:40.472421 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42589
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:44061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:40.556794 9171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:40.557090 9171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:40.557117 9171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:40.558255 9171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:40.558287 9171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:40.558314 9171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:47:40.559759 9171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42589
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:40.559965 9171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:40.560150 9171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:40.565414 9180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:40.565476 9181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:40.565456 9184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:40.565527 9171 server_base.cc:1034] running on GCE node
I20260811 16:47:40.565832 9171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:40.566089 9171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:40.567252 9171 hybrid_clock.cc:648] HybridClock initialized: now 1786466860567233 us; error 43 us; skew 500 ppm
Aug 11 16:47:40 dist-test-slave-3h5h krb5kdc[8761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466860, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:40.569867 9171 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:47:40.570302 9171 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:40.570376 9171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:40.570529 9171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:40.571604 9171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "fed13b1ae1644ad4a246110b9a013189"
format_stamp: "Formatted at 2026-08-11 16:47:40 on dist-test-slave-3h5h"
server_key: "6d82fcc264a58bd7d5ea02ea091a043b"
server_key_iv: "7145d82c03edd4eccb4b66639c376586"
server_key_version: "encryptionkey@0"
I20260811 16:47:40.571967 9171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "fed13b1ae1644ad4a246110b9a013189"
format_stamp: "Formatted at 2026-08-11 16:47:40 on dist-test-slave-3h5h"
server_key: "6d82fcc264a58bd7d5ea02ea091a043b"
server_key_iv: "7145d82c03edd4eccb4b66639c376586"
server_key_version: "encryptionkey@0"
I20260811 16:47:40.573385 9171 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:47:40.574252 9191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:40.574536 9171 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:40.574656 9171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "fed13b1ae1644ad4a246110b9a013189"
format_stamp: "Formatted at 2026-08-11 16:47:40 on dist-test-slave-3h5h"
server_key: "6d82fcc264a58bd7d5ea02ea091a043b"
server_key_iv: "7145d82c03edd4eccb4b66639c376586"
server_key_version: "encryptionkey@0"
I20260811 16:47:40.574735 9171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:40.584201 9171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:40.586236 9171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:40.586406 9171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:40.586651 9171 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:40.586995 9171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:40.587065 9171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:40.587106 9171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:40.587136 9171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:40.593919 9171 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:40459
I20260811 16:47:40.593952 9369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:40459 every 8 connection(s)
I20260811 16:47:40.594250 9171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:47:40.599749 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 9171
I20260811 16:47:40.599869 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:47:40.600127 2270 external_mini_cluster.cc:1428] Setting key 47a8d6e84e8fa1fdffc028c023302e11
Aug 11 16:47:40 dist-test-slave-3h5h krb5kdc[8761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466860, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:40.603750 8919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.595114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:54489 (local address 127.2.55.190:42589)
0811 16:47:40.595181 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:40.595183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:40.595319 (+ 136us) server_negotiation.cc:407] Connection header received
0811 16:47:40.595834 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:40.595835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:40.595849 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:40.595926 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:40.596977 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.597469 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.598432 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.598632 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.598689 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.600867 (+ 2178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:40.600868 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:40.600868 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:40.600876 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:40.602338 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:40.602805 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:40.602807 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:40.602807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:40.602876 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:40.603106 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:40.603107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:40.603107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:40.603254 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:40.603327 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:40.603575 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 16:47:40.603673 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 16:47:40.603814 9373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.595025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:42589 (local address 127.2.55.130:54489)
0811 16:47:40.595194 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:40.595236 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:40.595705 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:40.595986 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:40.595989 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:40.596248 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:40.596780 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:40.596785 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.597548 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.597548 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:40.598347 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:40.598349 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.598709 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.598710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:40.598805 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.599254 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:40.599262 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:40.600764 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:40.602453 (+ 1689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:40.602461 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:40.602463 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:40.602730 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:40.602945 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:40.602945 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:40.602945 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:40.603040 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:40.603320 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:40.603325 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:40.603434 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 16:47:40.603515 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 16:47:40.603652 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":99,"threads_started":1}
I20260811 16:47:40.604347 9371 heartbeater.cc:347] Connected to a master server at 127.2.55.190:42589
I20260811 16:47:40.604444 9371 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:40.604619 9371 heartbeater.cc:511] Master 127.2.55.190:42589 requested a full tablet report, sending...
I20260811 16:47:40.605038 8837 ts_manager.cc:194] Registered new tserver with Master: fed13b1ae1644ad4a246110b9a013189 (127.2.55.130:40459)
I20260811 16:47:40.605585 8837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:54489
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:47:40.630223 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42589
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:44061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:40.723403 9377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:40.723614 9377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:40.723640 9377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:40.724824 9377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:40.724925 9377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:40.724956 9377 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:47:40.726421 9377 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42589
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9377
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:40.726605 9377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:40.726794 9377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:40.732074 9389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:40.732069 9394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:40.732074 9390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:40.732093 9377 server_base.cc:1034] running on GCE node
I20260811 16:47:40.732596 9377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:40.732928 9377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:40.734200 9377 hybrid_clock.cc:648] HybridClock initialized: now 1786466860734158 us; error 60 us; skew 500 ppm
Aug 11 16:47:40 dist-test-slave-3h5h krb5kdc[8761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466860, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:40.737241 9377 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:47:40.737723 9377 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:40.737819 9377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:40.737995 9377 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:40.739272 9377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "d08a878add2b483aa2010fbaf78e1eae"
format_stamp: "Formatted at 2026-08-11 16:47:40 on dist-test-slave-3h5h"
server_key: "195031fdc53359a27e93b74a41a9cab3"
server_key_iv: "abe19e4f198f73d6dadc872e2842f1f1"
server_key_version: "encryptionkey@0"
I20260811 16:47:40.739703 9377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "d08a878add2b483aa2010fbaf78e1eae"
format_stamp: "Formatted at 2026-08-11 16:47:40 on dist-test-slave-3h5h"
server_key: "195031fdc53359a27e93b74a41a9cab3"
server_key_iv: "abe19e4f198f73d6dadc872e2842f1f1"
server_key_version: "encryptionkey@0"
I20260811 16:47:40.741309 9377 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 16:47:40.742273 9403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:40.742497 9377 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:40.742601 9377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "d08a878add2b483aa2010fbaf78e1eae"
format_stamp: "Formatted at 2026-08-11 16:47:40 on dist-test-slave-3h5h"
server_key: "195031fdc53359a27e93b74a41a9cab3"
server_key_iv: "abe19e4f198f73d6dadc872e2842f1f1"
server_key_version: "encryptionkey@0"
I20260811 16:47:40.742688 9377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:40.766007 9377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:40.768731 9377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:40.768911 9377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:40.769170 9377 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:40.769502 9377 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:40.769559 9377 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:40.769603 9377 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:40.769631 9377 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:40.775384 9377 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:41283
I20260811 16:47:40.775509 9577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:41283 every 8 connection(s)
I20260811 16:47:40.775736 9377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:47:40.776602 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 9377
I20260811 16:47:40.776710 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:47:40.776950 2270 external_mini_cluster.cc:1428] Setting key 337a1bd7ef19738854b99d606b83e099
Aug 11 16:47:40 dist-test-slave-3h5h krb5kdc[8761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466860, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:40.785977 8919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.776619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:46629 (local address 127.2.55.190:42589)
0811 16:47:40.776700 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:40.776703 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:40.776890 (+ 187us) server_negotiation.cc:407] Connection header received
0811 16:47:40.777509 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:40.777510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:40.777525 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:40.777591 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:40.778770 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.779310 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.780502 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.780683 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.780736 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.783285 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:40.783286 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:40.783287 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:40.783294 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:40.784616 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:40.785120 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:40.785121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:40.785121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:40.785173 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:40.785405 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:40.785405 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:40.785406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:40.785502 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:40.785558 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:40.785850 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 16:47:40.785911 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 16:47:40.786177 9582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.776539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:42589 (local address 127.2.55.131:46629)
0811 16:47:40.776734 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:40.776778 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:40.777368 (+ 590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:40.777660 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:40.777664 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:40.778092 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:40.778686 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:40.778692 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.779431 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.779432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:40.780418 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:40.780421 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.780763 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.780764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:40.780986 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.781671 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:40.781681 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:40.783191 (+ 1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:40.784698 (+ 1507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:40.784704 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:40.784706 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:40.785039 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:40.785235 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:40.785235 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:40.785236 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:40.785340 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:40.785583 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:40.785589 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:40.785719 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 16:47:40.785815 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 16:47:40.785951 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":98,"threads_started":1}
I20260811 16:47:40.786768 9580 heartbeater.cc:347] Connected to a master server at 127.2.55.190:42589
I20260811 16:47:40.786861 9580 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:40.786981 9580 heartbeater.cc:511] Master 127.2.55.190:42589 requested a full tablet report, sending...
I20260811 16:47:40.787388 8837 ts_manager.cc:194] Registered new tserver with Master: d08a878add2b483aa2010fbaf78e1eae (127.2.55.131:41283)
I20260811 16:47:40.787775 8837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:46629
I20260811 16:47:40.788796 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:47:40.795972 8919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.790148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46682 (local address 127.2.55.190:42589)
0811 16:47:40.790213 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:40.790215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:40.790240 (+ 25us) server_negotiation.cc:407] Connection header received
0811 16:47:40.790316 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:40.790317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:40.790326 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:40.790381 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:40.790934 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.791394 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.792107 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.792310 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.792383 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.793499 (+ 1116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:40.793500 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:40.793501 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:40.793507 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:40.794726 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:40.795115 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:40.795116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:40.795121 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:40.795171 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:40.795379 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:40.795380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:40.795380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:40.795546 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:40.795656 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:40.795799 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 16:47:40.795876 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:47:40.798002 8837 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46682:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:47:40.799609 8837 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:40.806742 9597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.802361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:36809 (local address 127.0.0.1:38748)
0811 16:47:40.802487 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:40.802497 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:40.802544 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:40.803215 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:40.803215 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:40.803227 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:40.803274 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:40.803276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.804451 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.804452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:40.805479 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:40.805482 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.806413 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.806415 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:40.806514 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.806527 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 16:47:40.806566 (+ 39us) client_negotiation.cc:240] Negotiation successful
0811 16:47:40.806627 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":57,"thread_start_us":77,"threads_started":1}
I20260811 16:47:40.806762 9600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.802793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34356 (local address 127.2.55.130:40459)
0811 16:47:40.803233 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:40.803238 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:40.803247 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:40.803286 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:40.803288 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:40.803304 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:40.803379 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:40.803576 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.804356 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.805822 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.806305 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.806406 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.806468 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:40.806637 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 16:47:40.806681 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":96,"threads_started":1}
I20260811 16:47:40.806913 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.802204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33352 (local address 127.2.55.131:41283)
0811 16:47:40.802430 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:40.802435 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:40.802446 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:47:40.802492 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:40.802494 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:40.802510 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:40.802607 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:40.802935 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.804072 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.805620 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.806308 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.806383 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.806443 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:40.806796 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 16:47:40.806839 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":134,"threads_started":1}
I20260811 16:47:40.806928 9601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.802810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38748 (local address 127.2.55.129:36809)
0811 16:47:40.803033 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:40.803038 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:40.803048 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:47:40.803085 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:40.803087 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:40.803102 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:40.803210 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:40.803352 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.804346 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.805576 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.806308 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.806730 (+ 422us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.806796 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:40.806820 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 16:47:40.806854 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":97,"threads_started":1}
I20260811 16:47:40.807114 9598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.802539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:40459 (local address 127.0.0.1:34356)
0811 16:47:40.802988 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:40.802999 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:40.803042 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:40.803464 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:40.803465 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:40.803466 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:40.803500 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:40.803501 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.804469 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.804470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:40.805732 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:40.805734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.806416 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.806417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:40.806499 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.806513 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:47:40.806616 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 16:47:40.806681 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"mutex_wait_us":33,"thread_start_us":62,"threads_started":1}
I20260811 16:47:40.806757 9595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.802106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:41283 (local address 127.0.0.1:33352)
0811 16:47:40.802258 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:40.802290 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:40.802370 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:40.802730 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:40.802734 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:40.802736 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:40.802817 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:40.802819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.804184 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.804185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:40.805547 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:40.805550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.806493 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.806494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:40.806578 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.806580 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:47:40.806627 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 16:47:40.806682 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":44,"thread_start_us":82,"threads_started":1}
I20260811 16:47:40.807685 9050 tablet_service.cc:1467] Processing CreateTablet for tablet d39d27dd5f3e4732ace522677466d218 (DEFAULT_TABLE table=test-table [id=980d4b276045426d9b9a189d9d514d8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:40.807749 9267 tablet_service.cc:1467] Processing CreateTablet for tablet d39d27dd5f3e4732ace522677466d218 (DEFAULT_TABLE table=test-table [id=980d4b276045426d9b9a189d9d514d8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:40.807928 9477 tablet_service.cc:1467] Processing CreateTablet for tablet d39d27dd5f3e4732ace522677466d218 (DEFAULT_TABLE table=test-table [id=980d4b276045426d9b9a189d9d514d8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:40.808076 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d39d27dd5f3e4732ace522677466d218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:40.808076 9050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d39d27dd5f3e4732ace522677466d218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:40.808290 9477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d39d27dd5f3e4732ace522677466d218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:40.811225 9602 tablet_bootstrap.cc:492] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae: Bootstrap starting.
I20260811 16:47:40.811650 9603 tablet_bootstrap.cc:492] T d39d27dd5f3e4732ace522677466d218 P e034beb33fca423bb23988fb0df43f94: Bootstrap starting.
I20260811 16:47:40.812139 9602 tablet_bootstrap.cc:654] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:40.812393 9603 tablet_bootstrap.cc:654] T d39d27dd5f3e4732ace522677466d218 P e034beb33fca423bb23988fb0df43f94: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:40.812737 9602 log.cc:824] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:40.812940 9603 log.cc:824] T d39d27dd5f3e4732ace522677466d218 P e034beb33fca423bb23988fb0df43f94: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:40.813175 9605 tablet_bootstrap.cc:492] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189: Bootstrap starting.
I20260811 16:47:40.813673 9602 tablet_bootstrap.cc:492] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae: No bootstrap required, opened a new log
I20260811 16:47:40.813709 9603 tablet_bootstrap.cc:492] T d39d27dd5f3e4732ace522677466d218 P e034beb33fca423bb23988fb0df43f94: No bootstrap required, opened a new log
I20260811 16:47:40.813769 9605 tablet_bootstrap.cc:654] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:40.813768 9603 ts_tablet_manager.cc:1397] T d39d27dd5f3e4732ace522677466d218 P e034beb33fca423bb23988fb0df43f94: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 16:47:40.813817 9602 ts_tablet_manager.cc:1397] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:47:40.814307 9605 log.cc:824] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:40.814999 9605 tablet_bootstrap.cc:492] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189: No bootstrap required, opened a new log
I20260811 16:47:40.815088 9605 ts_tablet_manager.cc:1397] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:47:40.815892 9602 raft_consensus.cc:348] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08a878add2b483aa2010fbaf78e1eae" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41283 } } peers { permanent_uuid: "e034beb33fca423bb23988fb0df43f94" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 36809 } } peers { permanent_uuid: "fed13b1ae1644ad4a246110b9a013189" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40459 } }
I20260811 16:47:40.816079 9602 raft_consensus.cc:374] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:40.816116 9602 raft_consensus.cc:729] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08a878add2b483aa2010fbaf78e1eae, State: Initialized, Role: FOLLOWER
I20260811 16:47:40.816028 9603 raft_consensus.cc:348] T d39d27dd5f3e4732ace522677466d218 P e034beb33fca423bb23988fb0df43f94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08a878add2b483aa2010fbaf78e1eae" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41283 } } peers { permanent_uuid: "e034beb33fca423bb23988fb0df43f94" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 36809 } } peers { permanent_uuid: "fed13b1ae1644ad4a246110b9a013189" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40459 } }
I20260811 16:47:40.816160 9603 raft_consensus.cc:374] T d39d27dd5f3e4732ace522677466d218 P e034beb33fca423bb23988fb0df43f94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:40.816220 9603 raft_consensus.cc:729] T d39d27dd5f3e4732ace522677466d218 P e034beb33fca423bb23988fb0df43f94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e034beb33fca423bb23988fb0df43f94, State: Initialized, Role: FOLLOWER
I20260811 16:47:40.816277 9602 consensus_queue.cc:260] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08a878add2b483aa2010fbaf78e1eae" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41283 } } peers { permanent_uuid: "e034beb33fca423bb23988fb0df43f94" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 36809 } } peers { permanent_uuid: "fed13b1ae1644ad4a246110b9a013189" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40459 } }
I20260811 16:47:40.816360 9603 consensus_queue.cc:260] T d39d27dd5f3e4732ace522677466d218 P e034beb33fca423bb23988fb0df43f94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08a878add2b483aa2010fbaf78e1eae" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41283 } } peers { permanent_uuid: "e034beb33fca423bb23988fb0df43f94" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 36809 } } peers { permanent_uuid: "fed13b1ae1644ad4a246110b9a013189" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40459 } }
I20260811 16:47:40.816674 9602 ts_tablet_manager.cc:1428] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:47:40.816674 9158 heartbeater.cc:503] Master 127.2.55.190:42589 was elected leader, sending a full tablet report...
I20260811 16:47:40.816795 9580 heartbeater.cc:503] Master 127.2.55.190:42589 was elected leader, sending a full tablet report...
I20260811 16:47:40.816674 9603 ts_tablet_manager.cc:1428] T d39d27dd5f3e4732ace522677466d218 P e034beb33fca423bb23988fb0df43f94: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 16:47:40.817384 9605 raft_consensus.cc:348] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08a878add2b483aa2010fbaf78e1eae" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41283 } } peers { permanent_uuid: "e034beb33fca423bb23988fb0df43f94" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 36809 } } peers { permanent_uuid: "fed13b1ae1644ad4a246110b9a013189" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40459 } }
I20260811 16:47:40.817559 9605 raft_consensus.cc:374] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:40.817615 9605 raft_consensus.cc:729] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fed13b1ae1644ad4a246110b9a013189, State: Initialized, Role: FOLLOWER
I20260811 16:47:40.817736 9605 consensus_queue.cc:260] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08a878add2b483aa2010fbaf78e1eae" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41283 } } peers { permanent_uuid: "e034beb33fca423bb23988fb0df43f94" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 36809 } } peers { permanent_uuid: "fed13b1ae1644ad4a246110b9a013189" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40459 } }
I20260811 16:47:40.818032 9605 ts_tablet_manager.cc:1428] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:47:40.818042 9371 heartbeater.cc:503] Master 127.2.55.190:42589 was elected leader, sending a full tablet report...
W20260811 16:47:40.844861 9372 tablet.cc:2369] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:47:40.885476 9614 raft_consensus.cc:482] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:40.885623 9614 raft_consensus.cc:504] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08a878add2b483aa2010fbaf78e1eae" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41283 } } peers { permanent_uuid: "e034beb33fca423bb23988fb0df43f94" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 36809 } } peers { permanent_uuid: "fed13b1ae1644ad4a246110b9a013189" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40459 } }
I20260811 16:47:40.886060 9614 leader_election.cc:288] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e034beb33fca423bb23988fb0df43f94 (127.2.55.129:36809), fed13b1ae1644ad4a246110b9a013189 (127.2.55.130:40459)
I20260811 16:47:40.890443 9601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.886379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:49989 (local address 127.2.55.129:36809)
0811 16:47:40.886448 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:40.886451 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:40.886470 (+ 19us) server_negotiation.cc:407] Connection header received
0811 16:47:40.886549 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:40.886550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:40.886565 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:40.886657 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:40.886857 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.887609 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.889235 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.889891 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.890105 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.890117 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:40.890326 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 16:47:40.890367 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:47:40.890443 9600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.886617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:53333 (local address 127.2.55.130:40459)
0811 16:47:40.886684 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:40.886686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:40.886865 (+ 179us) server_negotiation.cc:407] Connection header received
0811 16:47:40.886897 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:40.886897 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:40.886913 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:40.886977 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:40.887176 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.887829 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.889329 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.890038 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.890111 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.890118 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:40.890326 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 16:47:40.890367 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 16:47:40.890476 9582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.886256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:36809 (local address 127.2.55.131:49989)
0811 16:47:40.886327 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:40.886342 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:40.886470 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:40.886678 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:40.886679 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:40.886681 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:40.886767 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:40.886770 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.887710 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.887711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:40.889131 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:40.889135 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.890129 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.890130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:40.890226 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.890230 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:40.890300 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 16:47:40.890348 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":9}
I20260811 16:47:40.890486 9617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.886520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:40459 (local address 127.2.55.131:53333)
0811 16:47:40.886742 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:40.886753 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:40.886819 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:40.886994 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:40.886994 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:40.886996 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:40.887098 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:40.887099 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.887905 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.887906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:40.889233 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:40.889235 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.890129 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.890130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:40.890224 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.890230 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:47:40.890300 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 16:47:40.890348 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":3,"thread_start_us":136,"threads_started":1}
I20260811 16:47:40.890888 9082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d39d27dd5f3e4732ace522677466d218" candidate_uuid: "d08a878add2b483aa2010fbaf78e1eae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e034beb33fca423bb23988fb0df43f94" is_pre_election: true
I20260811 16:47:40.891091 9082 raft_consensus.cc:2454] T d39d27dd5f3e4732ace522677466d218 P e034beb33fca423bb23988fb0df43f94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d08a878add2b483aa2010fbaf78e1eae in term 0.
I20260811 16:47:40.891275 9294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d39d27dd5f3e4732ace522677466d218" candidate_uuid: "d08a878add2b483aa2010fbaf78e1eae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fed13b1ae1644ad4a246110b9a013189" is_pre_election: true
I20260811 16:47:40.891360 9410 leader_election.cc:302] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08a878add2b483aa2010fbaf78e1eae, e034beb33fca423bb23988fb0df43f94; no voters:
I20260811 16:47:40.891438 9294 raft_consensus.cc:2454] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d08a878add2b483aa2010fbaf78e1eae in term 0.
I20260811 16:47:40.891502 9614 raft_consensus.cc:2781] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:40.891592 9614 raft_consensus.cc:482] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:40.891623 9614 raft_consensus.cc:3037] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:40.892452 9614 raft_consensus.cc:504] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08a878add2b483aa2010fbaf78e1eae" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41283 } } peers { permanent_uuid: "e034beb33fca423bb23988fb0df43f94" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 36809 } } peers { permanent_uuid: "fed13b1ae1644ad4a246110b9a013189" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40459 } }
I20260811 16:47:40.892606 9614 leader_election.cc:288] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [CANDIDATE]: Term 1 election: Requested vote from peers e034beb33fca423bb23988fb0df43f94 (127.2.55.129:36809), fed13b1ae1644ad4a246110b9a013189 (127.2.55.130:40459)
I20260811 16:47:40.892771 9082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d39d27dd5f3e4732ace522677466d218" candidate_uuid: "d08a878add2b483aa2010fbaf78e1eae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e034beb33fca423bb23988fb0df43f94"
I20260811 16:47:40.892817 9294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d39d27dd5f3e4732ace522677466d218" candidate_uuid: "d08a878add2b483aa2010fbaf78e1eae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fed13b1ae1644ad4a246110b9a013189"
I20260811 16:47:40.892910 9082 raft_consensus.cc:3037] T d39d27dd5f3e4732ace522677466d218 P e034beb33fca423bb23988fb0df43f94 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:40.892928 9294 raft_consensus.cc:3037] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:40.893671 9294 raft_consensus.cc:2454] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08a878add2b483aa2010fbaf78e1eae in term 1.
I20260811 16:47:40.893787 9082 raft_consensus.cc:2454] T d39d27dd5f3e4732ace522677466d218 P e034beb33fca423bb23988fb0df43f94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d08a878add2b483aa2010fbaf78e1eae in term 1.
I20260811 16:47:40.893877 9410 leader_election.cc:302] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d08a878add2b483aa2010fbaf78e1eae, fed13b1ae1644ad4a246110b9a013189; no voters:
I20260811 16:47:40.894023 9614 raft_consensus.cc:2781] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:40.894253 9614 raft_consensus.cc:686] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [term 1 LEADER]: Becoming Leader. State: Replica: d08a878add2b483aa2010fbaf78e1eae, State: Running, Role: LEADER
I20260811 16:47:40.894361 9614 consensus_queue.cc:237] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08a878add2b483aa2010fbaf78e1eae" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41283 } } peers { permanent_uuid: "e034beb33fca423bb23988fb0df43f94" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 36809 } } peers { permanent_uuid: "fed13b1ae1644ad4a246110b9a013189" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40459 } }
I20260811 16:47:40.895351 8837 catalog_manager.cc:5495] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae reported cstate change: term changed from 0 to 1, leader changed from <none> to d08a878add2b483aa2010fbaf78e1eae (127.2.55.131). New cstate: current_term: 1 leader_uuid: "d08a878add2b483aa2010fbaf78e1eae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08a878add2b483aa2010fbaf78e1eae" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e034beb33fca423bb23988fb0df43f94" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fed13b1ae1644ad4a246110b9a013189" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40459 } health_report { overall_health: UNKNOWN } } }
I20260811 16:47:40.900835 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.898398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33360 (local address 127.2.55.131:41283)
0811 16:47:40.898452 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:40.898454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:40.898463 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:40.898535 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:40.898536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:40.898553 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:40.898615 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:40.898736 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.899224 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.900047 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:40.900251 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:40.900325 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:40.900442 (+ 117us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:40.900551 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:40.900616 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:40.900653 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 16:47:40.900673 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:47:40.902765 9294 raft_consensus.cc:1261] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189 [term 1 FOLLOWER]: Refusing update from remote peer d08a878add2b483aa2010fbaf78e1eae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:40.902765 9082 raft_consensus.cc:1261] T d39d27dd5f3e4732ace522677466d218 P e034beb33fca423bb23988fb0df43f94 [term 1 FOLLOWER]: Refusing update from remote peer d08a878add2b483aa2010fbaf78e1eae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:40.903128 9614 consensus_queue.cc:1035] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [LEADER]: Connected to new peer: Peer: permanent_uuid: "fed13b1ae1644ad4a246110b9a013189" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:40.903286 9618 consensus_queue.cc:1035] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e034beb33fca423bb23988fb0df43f94" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:40.906268 9630 mvcc.cc:205] Tried to move back new op lower bound from 7317368262254886912 to 7317368262223982592. Current Snapshot: MvccSnapshot[applied={T|T < 7317368262254886912}]
I20260811 16:47:40.906658 9627 mvcc.cc:205] Tried to move back new op lower bound from 7317368262254886912 to 7317368262223982592. Current Snapshot: MvccSnapshot[applied={T|T < 7317368262254886912}]
I20260811 16:47:40.908963 8837 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:40.909075 8837 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46682:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:40.909888 8837 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 783cff6a7f4c4374b277233990f2f90c: Sending DeleteTablet for 3 replicas of tablet d39d27dd5f3e4732ace522677466d218
I20260811 16:47:40.910359 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet d39d27dd5f3e4732ace522677466d218 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:40 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:34356
I20260811 16:47:40.910342 9050 tablet_service.cc:1514] Processing DeleteTablet for tablet d39d27dd5f3e4732ace522677466d218 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:40 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:38748
I20260811 16:47:40.910626 9643 tablet_replica.cc:330] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189: stopping tablet replica
I20260811 16:47:40.910693 9477 tablet_service.cc:1514] Processing DeleteTablet for tablet d39d27dd5f3e4732ace522677466d218 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:40 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:33352
I20260811 16:47:40.910765 9643 raft_consensus.cc:2229] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:40.910878 9643 raft_consensus.cc:2258] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:40.910877 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 8942
I20260811 16:47:40.914611 9643 ts_tablet_manager.cc:1905] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:40.917176 9643 ts_tablet_manager.cc:1918] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:40.917371 9643 log.cc:1196] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/d39d27dd5f3e4732ace522677466d218
I20260811 16:47:40.917847 9643 ts_tablet_manager.cc:1939] T d39d27dd5f3e4732ace522677466d218 P fed13b1ae1644ad4a246110b9a013189: Deleting consensus metadata
I20260811 16:47:40.918402 8818 catalog_manager.cc:4841] TS fed13b1ae1644ad4a246110b9a013189 (127.2.55.130:40459): tablet d39d27dd5f3e4732ace522677466d218 (table test-table [id=980d4b276045426d9b9a189d9d514d8c]) successfully deleted
I20260811 16:47:40.926689 9644 tablet_replica.cc:330] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae: stopping tablet replica
I20260811 16:47:40.926884 9644 raft_consensus.cc:2229] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:47:40.927120 9644 raft_consensus.cc:2258] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:40.927760 9644 ts_tablet_manager.cc:1905] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:40.929826 9644 ts_tablet_manager.cc:1918] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:40.929970 9644 log.cc:1196] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/d39d27dd5f3e4732ace522677466d218
I20260811 16:47:40.930336 9644 ts_tablet_manager.cc:1939] T d39d27dd5f3e4732ace522677466d218 P d08a878add2b483aa2010fbaf78e1eae: Deleting consensus metadata
I20260811 16:47:40.930914 8818 catalog_manager.cc:4841] TS d08a878add2b483aa2010fbaf78e1eae (127.2.55.131:41283): tablet d39d27dd5f3e4732ace522677466d218 (table test-table [id=980d4b276045426d9b9a189d9d514d8c]) successfully deleted
W20260811 16:47:40.931679 8818 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.55.129:36809 (error 108)
I20260811 16:47:40.931957 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 9171
I20260811 16:47:40.942776 9595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:40.932110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:36809 (local address 127.0.0.1:38762)
0811 16:47:40.942626 (+ 10516us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:40.942715 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:36809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10480}
W20260811 16:47:40.951350 8818 catalog_manager.cc:4584] TS e034beb33fca423bb23988fb0df43f94 (127.2.55.129:36809): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d39d27dd5f3e4732ace522677466d218: Network error: Client connection negotiation failed: client connection to 127.2.55.129:36809: connect: Connection refused (error 111)
I20260811 16:47:40.957324 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 9377
I20260811 16:47:40.971678 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 8784
2026-08-11T16:47:40Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (3188 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T16:47:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:41Z Disabled control of system clock
I20260811 16:47:41.011493 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:39415
--webserver_interface=127.2.55.190
--webserver_port=0
--builtin_ntp_servers=127.2.55.148:46113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:39415
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 16:47:41.096568 9649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:41.096771 9649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:41.096791 9649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:41.097927 9649 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:41.097968 9649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:41.097981 9649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:41.097994 9649 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:41.098006 9649 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:41.099313 9649 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:46113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:39415
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:39415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:41.099514 9649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:41.099787 9649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:41.105058 9656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:41.105047 9659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:41.105170 9657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:41.105229 9649 server_base.cc:1034] running on GCE node
I20260811 16:47:41.105621 9649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:41.105894 9649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:41.107095 9649 hybrid_clock.cc:648] HybridClock initialized: now 1786466861107068 us; error 44 us; skew 500 ppm
I20260811 16:47:41.108434 9649 webserver.cc:460] Webserver started at http://127.2.55.190:44943/ using document root <none> and password file <none>
I20260811 16:47:41.108711 9649 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:41.108783 9649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:41.108954 9649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:41.110040 9649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "a1cfaca66e8648e9a04108c7db78b64c"
format_stamp: "Formatted at 2026-08-11 16:47:41 on dist-test-slave-3h5h"
server_key: "5d2a10dd4ff4ab2b545748d98b467d7a"
server_key_iv: "63604e11139b6b5031a7b35f922f0c7b"
server_key_version: "encryptionkey@0"
I20260811 16:47:41.110630 9649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "a1cfaca66e8648e9a04108c7db78b64c"
format_stamp: "Formatted at 2026-08-11 16:47:41 on dist-test-slave-3h5h"
server_key: "5d2a10dd4ff4ab2b545748d98b467d7a"
server_key_iv: "63604e11139b6b5031a7b35f922f0c7b"
server_key_version: "encryptionkey@0"
I20260811 16:47:41.112130 9649 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:41.112984 9671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:41.113247 9649 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:41.113361 9649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "a1cfaca66e8648e9a04108c7db78b64c"
format_stamp: "Formatted at 2026-08-11 16:47:41 on dist-test-slave-3h5h"
server_key: "5d2a10dd4ff4ab2b545748d98b467d7a"
server_key_iv: "63604e11139b6b5031a7b35f922f0c7b"
server_key_version: "encryptionkey@0"
I20260811 16:47:41.113473 9649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:41.116973 9649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:41.117257 9649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:41.117415 9649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:41.121616 9649 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:39415
I20260811 16:47:41.121666 9749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:39415 every 8 connection(s)
I20260811 16:47:41.122011 9649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:41.122727 9750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:41.125663 9750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c: Bootstrap starting.
I20260811 16:47:41.126257 9750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:41.126356 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 9649
I20260811 16:47:41.126482 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:41.126626 9750 log.cc:824] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:41.126696 2270 external_mini_cluster.cc:1428] Setting key 77003af765de81017e7d62f3a16c5750
I20260811 16:47:41.127761 9750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c: No bootstrap required, opened a new log
I20260811 16:47:41.129509 9755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.127303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57262 (local address 127.2.55.190:39415)
0811 16:47:41.127527 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:41.127534 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:41.127564 (+ 30us) server_negotiation.cc:407] Connection header received
0811 16:47:41.128050 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:41.128057 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:41.128098 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:41.128212 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:41.128955 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:41.128959 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:41.128959 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:47:41.129005 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:41.129062 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:47:41.129076 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:41.129170 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:41.129236 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 16:47:41.129304 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":84,"threads_started":1}
I20260811 16:47:41.129951 9750 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1cfaca66e8648e9a04108c7db78b64c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39415 } }
I20260811 16:47:41.130182 9750 raft_consensus.cc:374] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:41.130236 9750 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1cfaca66e8648e9a04108c7db78b64c, State: Initialized, Role: FOLLOWER
I20260811 16:47:41.130366 9750 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1cfaca66e8648e9a04108c7db78b64c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39415 } }
I20260811 16:47:41.130743 9750 raft_consensus.cc:388] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:41.130795 9750 raft_consensus.cc:482] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:41.130846 9750 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:41.131440 9750 raft_consensus.cc:504] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1cfaca66e8648e9a04108c7db78b64c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39415 } }
I20260811 16:47:41.131569 9750 leader_election.cc:302] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1cfaca66e8648e9a04108c7db78b64c; no voters:
I20260811 16:47:41.131752 9750 leader_election.cc:288] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:41.131801 9756 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:41.132028 9750 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:41.132011 9756 raft_consensus.cc:686] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [term 1 LEADER]: Becoming Leader. State: Replica: a1cfaca66e8648e9a04108c7db78b64c, State: Running, Role: LEADER
I20260811 16:47:41.132258 9756 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1cfaca66e8648e9a04108c7db78b64c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39415 } }
I20260811 16:47:41.132742 9759 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1cfaca66e8648e9a04108c7db78b64c. Latest consensus state: current_term: 1 leader_uuid: "a1cfaca66e8648e9a04108c7db78b64c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1cfaca66e8648e9a04108c7db78b64c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39415 } } }
I20260811 16:47:41.132897 9759 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:41.133117 9758 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1cfaca66e8648e9a04108c7db78b64c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1cfaca66e8648e9a04108c7db78b64c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39415 } } }
I20260811 16:47:41.133235 9758 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:41.133152 9767 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:41.133896 9767 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:41.135438 9767 catalog_manager.cc:1347] Generated new cluster ID: 871535ecbe7940fea357030663cbda62
I20260811 16:47:41.135548 9767 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:47:41.145920 9767 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:41.146113 9767 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:41.153198 9767 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c: Generated new TSK 0
I20260811 16:47:41.153396 9767 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:47:41.155452 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:39415
--builtin_ntp_servers=127.2.55.148:46113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 16:47:41.240466 9788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:41.240813 9788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:41.240883 9788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:41.242161 9788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:41.242202 9788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:41.242228 9788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:47:41.243600 9788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:46113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:39415
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:41.243877 9788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:41.244202 9788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:41.250351 9800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:41.250342 9799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:41.250344 9803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:41.251061 9788 server_base.cc:1034] running on GCE node
I20260811 16:47:41.251307 9788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:41.251591 9788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:41.252758 9788 hybrid_clock.cc:648] HybridClock initialized: now 1786466861252745 us; error 27 us; skew 500 ppm
I20260811 16:47:41.254369 9788 webserver.cc:460] Webserver started at http://127.2.55.129:33661/ using document root <none> and password file <none>
I20260811 16:47:41.254634 9788 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:41.254680 9788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:41.254829 9788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:41.255927 9788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "3ca0cadefc37484ab84fde2a382a7c3e"
format_stamp: "Formatted at 2026-08-11 16:47:41 on dist-test-slave-3h5h"
server_key: "6df39d3a7f229a27c929d0e235227a08"
server_key_iv: "0b1ad5950876913a7331ed942231d34a"
server_key_version: "encryptionkey@0"
I20260811 16:47:41.256305 9788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "3ca0cadefc37484ab84fde2a382a7c3e"
format_stamp: "Formatted at 2026-08-11 16:47:41 on dist-test-slave-3h5h"
server_key: "6df39d3a7f229a27c929d0e235227a08"
server_key_iv: "0b1ad5950876913a7331ed942231d34a"
server_key_version: "encryptionkey@0"
I20260811 16:47:41.257773 9788 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:41.258575 9815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:41.258734 9788 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:41.258828 9788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "3ca0cadefc37484ab84fde2a382a7c3e"
format_stamp: "Formatted at 2026-08-11 16:47:41 on dist-test-slave-3h5h"
server_key: "6df39d3a7f229a27c929d0e235227a08"
server_key_iv: "0b1ad5950876913a7331ed942231d34a"
server_key_version: "encryptionkey@0"
I20260811 16:47:41.258906 9788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:41.262370 9788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:41.262657 9788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:41.262806 9788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:41.263056 9788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:41.263439 9788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:41.263477 9788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:41.263499 9788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:41.263510 9788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:41.269640 9788 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:42663
I20260811 16:47:41.269687 9987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:42663 every 8 connection(s)
I20260811 16:47:41.270018 9788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:47:41.271498 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 9788
I20260811 16:47:41.271641 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:47:41.271831 2270 external_mini_cluster.cc:1428] Setting key 47d9b7105508b00de303fac81f085022
I20260811 16:47:41.273002 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:39415
--builtin_ntp_servers=127.2.55.148:46113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 16:47:41.273434 9755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.270793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:38957 (local address 127.2.55.190:39415)
0811 16:47:41.270850 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:41.270852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:41.271123 (+ 271us) server_negotiation.cc:407] Connection header received
0811 16:47:41.271639 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:41.271640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:41.271647 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:41.271695 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:41.273146 (+ 1451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:41.273148 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:41.273148 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:47:41.273153 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:41.273168 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:47:41.273173 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:41.273225 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:41.273352 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 16:47:41.273367 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:47:41.273787 9994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.270773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39415 (local address 127.2.55.129:38957)
0811 16:47:41.270985 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:41.271026 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:41.271533 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:41.271758 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:41.271762 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:41.271772 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:41.272984 (+ 1212us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:47:41.272985 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:41.273014 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:47:41.273043 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:41.273253 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:41.273261 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:41.273264 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:47:41.273555 (+ 291us) client_negotiation.cc:240] Negotiation successful
0811 16:47:41.273625 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":90,"threads_started":1}
I20260811 16:47:41.274400 9988 heartbeater.cc:347] Connected to a master server at 127.2.55.190:39415
I20260811 16:47:41.274524 9988 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:41.274693 9988 heartbeater.cc:511] Master 127.2.55.190:39415 requested a full tablet report, sending...
I20260811 16:47:41.275398 9697 ts_manager.cc:194] Registered new tserver with Master: 3ca0cadefc37484ab84fde2a382a7c3e (127.2.55.129:42663)
W20260811 16:47:41.361641 9995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:41.361860 9995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:41.361897 9995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:41.363152 9995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:41.363210 9995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:41.363252 9995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:47:41.364650 9995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:46113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:39415
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:41.364933 9995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:41.365247 9995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:41.370517 10011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:41.370575 10005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:41.370730 9995 server_base.cc:1034] running on GCE node
W20260811 16:47:41.370918 10004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:41.371275 9995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:41.371596 9995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:41.372769 9995 hybrid_clock.cc:648] HybridClock initialized: now 1786466861372746 us; error 41 us; skew 500 ppm
I20260811 16:47:41.374215 9995 webserver.cc:460] Webserver started at http://127.2.55.130:43815/ using document root <none> and password file <none>
I20260811 16:47:41.374538 9995 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:41.374624 9995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:41.374799 9995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:41.375950 9995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "f3f7a736f94b451087b9a344e2d7d202"
format_stamp: "Formatted at 2026-08-11 16:47:41 on dist-test-slave-3h5h"
server_key: "59b4b0326d4fc3445e0d4526eec66078"
server_key_iv: "a2cccdee2172476811b2ccd506e97e61"
server_key_version: "encryptionkey@0"
I20260811 16:47:41.376349 9995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "f3f7a736f94b451087b9a344e2d7d202"
format_stamp: "Formatted at 2026-08-11 16:47:41 on dist-test-slave-3h5h"
server_key: "59b4b0326d4fc3445e0d4526eec66078"
server_key_iv: "a2cccdee2172476811b2ccd506e97e61"
server_key_version: "encryptionkey@0"
I20260811 16:47:41.378049 9995 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 16:47:41.378906 10019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:41.379173 9995 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:41.379266 9995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "f3f7a736f94b451087b9a344e2d7d202"
format_stamp: "Formatted at 2026-08-11 16:47:41 on dist-test-slave-3h5h"
server_key: "59b4b0326d4fc3445e0d4526eec66078"
server_key_iv: "a2cccdee2172476811b2ccd506e97e61"
server_key_version: "encryptionkey@0"
I20260811 16:47:41.379329 9995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:41.382688 9995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:41.382900 9995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:41.382997 9995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:41.383147 9995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:41.383453 9995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:41.383494 9995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:41.383514 9995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:41.383560 9995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:41.389124 9995 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:44303
I20260811 16:47:41.389223 10190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:44303 every 8 connection(s)
I20260811 16:47:41.389539 9995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:47:41.392380 9755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.390312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:49221 (local address 127.2.55.190:39415)
0811 16:47:41.390381 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:41.390384 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:41.390613 (+ 229us) server_negotiation.cc:407] Connection header received
0811 16:47:41.391064 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:41.391065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:41.391071 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:41.391127 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:41.392196 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:41.392198 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:41.392198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:47:41.392202 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:41.392216 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:47:41.392219 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:41.392265 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:41.392311 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 16:47:41.392322 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:47:41.392585 10196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.390297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39415 (local address 127.2.55.130:49221)
0811 16:47:41.390500 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:41.390530 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:41.390978 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:41.391179 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:41.391183 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:41.391191 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:41.392064 (+ 873us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:47:41.392064 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:41.392090 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:47:41.392116 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:41.392264 (+ 148us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:41.392266 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:41.392268 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:47:41.392317 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 16:47:41.392361 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":107,"threads_started":1}
I20260811 16:47:41.393170 10193 heartbeater.cc:347] Connected to a master server at 127.2.55.190:39415
I20260811 16:47:41.393252 10193 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:41.393360 10193 heartbeater.cc:511] Master 127.2.55.190:39415 requested a full tablet report, sending...
I20260811 16:47:41.393703 9697 ts_manager.cc:194] Registered new tserver with Master: f3f7a736f94b451087b9a344e2d7d202 (127.2.55.130:44303)
I20260811 16:47:41.399549 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 9995
I20260811 16:47:41.399641 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:47:41.399776 2270 external_mini_cluster.cc:1428] Setting key 739e9a184765e96e74276f0cc4ec4a52
I20260811 16:47:41.400730 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:39415
--builtin_ntp_servers=127.2.55.148:46113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 16:47:41.486351 10200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:41.486555 10200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:41.486577 10200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:41.487664 10200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:41.487696 10200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:41.487721 10200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:47:41.489017 10200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:46113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:39415
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:41.489208 10200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:41.489459 10200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:41.494863 10208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:41.494863 10212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:41.495040 10209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:41.495253 10200 server_base.cc:1034] running on GCE node
I20260811 16:47:41.495554 10200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:41.495844 10200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:41.497056 10200 hybrid_clock.cc:648] HybridClock initialized: now 1786466861497024 us; error 43 us; skew 500 ppm
I20260811 16:47:41.498454 10200 webserver.cc:460] Webserver started at http://127.2.55.131:38093/ using document root <none> and password file <none>
I20260811 16:47:41.498733 10200 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:41.498809 10200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:41.498962 10200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:41.500061 10200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "e5a2b1805e7048c18e4236ac616f061d"
format_stamp: "Formatted at 2026-08-11 16:47:41 on dist-test-slave-3h5h"
server_key: "c268310ac15b22338bbf94be404af2c0"
server_key_iv: "80fba81b3d3cda48a0c0d7d20c8e936c"
server_key_version: "encryptionkey@0"
I20260811 16:47:41.500422 10200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "e5a2b1805e7048c18e4236ac616f061d"
format_stamp: "Formatted at 2026-08-11 16:47:41 on dist-test-slave-3h5h"
server_key: "c268310ac15b22338bbf94be404af2c0"
server_key_iv: "80fba81b3d3cda48a0c0d7d20c8e936c"
server_key_version: "encryptionkey@0"
I20260811 16:47:41.502090 10200 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:47:41.503017 10220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:41.503206 10200 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:47:41.503329 10200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "e5a2b1805e7048c18e4236ac616f061d"
format_stamp: "Formatted at 2026-08-11 16:47:41 on dist-test-slave-3h5h"
server_key: "c268310ac15b22338bbf94be404af2c0"
server_key_iv: "80fba81b3d3cda48a0c0d7d20c8e936c"
server_key_version: "encryptionkey@0"
I20260811 16:47:41.503407 10200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:41.506918 10200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:41.507187 10200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:41.507325 10200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:41.507537 10200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:41.507838 10200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:41.507901 10200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:41.507942 10200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:41.507969 10200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:41.513830 10200 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:40033
I20260811 16:47:41.513875 10403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:40033 every 8 connection(s)
I20260811 16:47:41.514192 10200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:47:41.516489 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 10200
I20260811 16:47:41.516589 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:47:41.516737 2270 external_mini_cluster.cc:1428] Setting key e8421b20eb710819a195be946a60d8ea
I20260811 16:47:41.517616 9755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.514923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:35041 (local address 127.2.55.190:39415)
0811 16:47:41.514996 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:41.514998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:41.515229 (+ 231us) server_negotiation.cc:407] Connection header received
0811 16:47:41.515859 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:41.515860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:41.515866 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:41.515927 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:41.517323 (+ 1396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:41.517324 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:41.517325 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:47:41.517330 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:41.517346 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:47:41.517350 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:41.517432 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:41.517526 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 16:47:41.517542 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 16:47:41.517827 10408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.514895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39415 (local address 127.2.55.131:35041)
0811 16:47:41.515076 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:41.515118 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:41.515778 (+ 660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:41.515975 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:41.515978 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:41.515986 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:41.517167 (+ 1181us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:47:41.517167 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:41.517196 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:47:41.517224 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:41.517431 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:41.517437 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:41.517440 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:47:41.517561 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 16:47:41.517632 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":89,"threads_started":1}
I20260811 16:47:41.518234 10404 heartbeater.cc:347] Connected to a master server at 127.2.55.190:39415
I20260811 16:47:41.518311 10404 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:41.518476 10404 heartbeater.cc:511] Master 127.2.55.190:39415 requested a full tablet report, sending...
I20260811 16:47:41.518842 9697 ts_manager.cc:194] Registered new tserver with Master: e5a2b1805e7048c18e4236ac616f061d (127.2.55.131:40033)
I20260811 16:47:41.528373 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:47:41.531378 9755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.530059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57268 (local address 127.2.55.190:39415)
0811 16:47:41.530148 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:41.530150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:41.530253 (+ 103us) server_negotiation.cc:407] Connection header received
0811 16:47:41.530347 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:41.530348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:41.530355 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:41.530430 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:41.531104 (+ 674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:41.531106 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:41.531106 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:47:41.531110 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:41.531124 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:47:41.531128 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:41.531210 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:41.531279 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 16:47:41.531296 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 16:47:41.533272 9697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57268:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:47:41.534931 9697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:41.539697 10417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.537723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:42663 (local address 127.0.0.1:35084)
0811 16:47:41.537898 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:41.537907 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:41.537941 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:41.538627 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:41.538628 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:41.538630 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:41.539269 (+ 639us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:47:41.539270 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:41.539274 (+ 4us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:47:41.539284 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:41.539538 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:41.539539 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:41.539542 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:47:41.539608 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 16:47:41.539618 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":78,"threads_started":1}
I20260811 16:47:41.539765 10422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.537603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50262 (local address 127.2.55.131:40033)
0811 16:47:41.538417 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:41.538421 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:41.538430 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:41.538453 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:41.538455 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:41.538463 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:41.538580 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:41.539369 (+ 789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:41.539379 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:41.539379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:47:41.539384 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:41.539419 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:47:41.539445 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:41.539501 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:41.539658 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 16:47:41.539674 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":770,"thread_start_us":94,"threads_started":1}
I20260811 16:47:41.539763 10427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.537953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35084 (local address 127.2.55.129:42663)
0811 16:47:41.538154 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:41.538159 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:41.538169 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:47:41.538203 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:41.538205 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:41.538233 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:41.538314 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:41.539370 (+ 1056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:41.539379 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:41.539380 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:47:41.539384 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:41.539419 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:47:41.539448 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:41.539502 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:41.539641 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 16:47:41.539661 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":92,"threads_started":1}
I20260811 16:47:41.539994 10423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.537599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43876 (local address 127.2.55.130:44303)
0811 16:47:41.538210 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:41.538215 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:41.538226 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:47:41.538252 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:41.538254 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:41.538263 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:41.538911 (+ 648us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:41.539521 (+ 610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:41.539530 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:41.539530 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:47:41.539535 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:41.539569 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:47:41.539611 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:41.539885 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:41.539908 (+ 23us) server_negotiation.cc:299] Negotiation successful
0811 16:47:41.539923 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":96,"threads_started":1}
I20260811 16:47:41.539819 10426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.537488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:44303 (local address 127.0.0.1:43876)
0811 16:47:41.537870 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:41.537880 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:41.537925 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:41.538928 (+ 1003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:41.538929 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:41.538931 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:41.539404 (+ 473us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:47:41.539405 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:41.539412 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:47:41.539425 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:41.539699 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:41.539699 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:41.539700 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:47:41.539731 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 16:47:41.539743 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"mutex_wait_us":2,"thread_start_us":96,"threads_started":1}
I20260811 16:47:41.540249 10421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.537488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:40033 (local address 127.0.0.1:50262)
0811 16:47:41.537696 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:41.537737 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:41.537794 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:41.538585 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:41.538592 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:41.538599 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:41.539222 (+ 623us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:47:41.539223 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:41.539242 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:47:41.539268 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:41.539530 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:41.539537 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:41.539539 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:47:41.539603 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:47:41.539618 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":91,"threads_started":1}
I20260811 16:47:41.541050 9891 tablet_service.cc:1467] Processing CreateTablet for tablet abc98f3b4cba44b9b07269f1f0c72489 (DEFAULT_TABLE table=test-table [id=9757c45d2f624ebaaca7b4bb178df2ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:41.541047 10298 tablet_service.cc:1467] Processing CreateTablet for tablet abc98f3b4cba44b9b07269f1f0c72489 (DEFAULT_TABLE table=test-table [id=9757c45d2f624ebaaca7b4bb178df2ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:41.541046 10092 tablet_service.cc:1467] Processing CreateTablet for tablet abc98f3b4cba44b9b07269f1f0c72489 (DEFAULT_TABLE table=test-table [id=9757c45d2f624ebaaca7b4bb178df2ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:41.541429 10298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abc98f3b4cba44b9b07269f1f0c72489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:41.541429 9891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abc98f3b4cba44b9b07269f1f0c72489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:41.541450 10092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abc98f3b4cba44b9b07269f1f0c72489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:41.544159 10428 tablet_bootstrap.cc:492] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202: Bootstrap starting.
I20260811 16:47:41.544662 10429 tablet_bootstrap.cc:492] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e: Bootstrap starting.
I20260811 16:47:41.544806 10428 tablet_bootstrap.cc:654] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:41.545243 10428 log.cc:824] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:41.545491 10429 tablet_bootstrap.cc:654] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:41.545944 10429 log.cc:824] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:41.546192 10428 tablet_bootstrap.cc:492] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202: No bootstrap required, opened a new log
I20260811 16:47:41.546269 10428 ts_tablet_manager.cc:1397] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:47:41.546283 10434 tablet_bootstrap.cc:492] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d: Bootstrap starting.
I20260811 16:47:41.546967 10434 tablet_bootstrap.cc:654] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:41.547295 10434 log.cc:824] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:41.547839 10429 tablet_bootstrap.cc:492] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e: No bootstrap required, opened a new log
I20260811 16:47:41.547914 10429 ts_tablet_manager.cc:1397] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:47:41.548103 10434 tablet_bootstrap.cc:492] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d: No bootstrap required, opened a new log
I20260811 16:47:41.548207 10434 ts_tablet_manager.cc:1397] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:47:41.549098 10428 raft_consensus.cc:348] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3f7a736f94b451087b9a344e2d7d202" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44303 } } peers { permanent_uuid: "3ca0cadefc37484ab84fde2a382a7c3e" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42663 } } peers { permanent_uuid: "e5a2b1805e7048c18e4236ac616f061d" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 40033 } }
I20260811 16:47:41.549433 10428 raft_consensus.cc:374] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:41.549521 10428 raft_consensus.cc:729] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3f7a736f94b451087b9a344e2d7d202, State: Initialized, Role: FOLLOWER
I20260811 16:47:41.549690 10428 consensus_queue.cc:260] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3f7a736f94b451087b9a344e2d7d202" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44303 } } peers { permanent_uuid: "3ca0cadefc37484ab84fde2a382a7c3e" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42663 } } peers { permanent_uuid: "e5a2b1805e7048c18e4236ac616f061d" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 40033 } }
I20260811 16:47:41.550058 10193 heartbeater.cc:503] Master 127.2.55.190:39415 was elected leader, sending a full tablet report...
I20260811 16:47:41.550391 10428 ts_tablet_manager.cc:1428] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 16:47:41.550668 10429 raft_consensus.cc:348] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3f7a736f94b451087b9a344e2d7d202" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44303 } } peers { permanent_uuid: "3ca0cadefc37484ab84fde2a382a7c3e" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42663 } } peers { permanent_uuid: "e5a2b1805e7048c18e4236ac616f061d" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 40033 } }
I20260811 16:47:41.550827 10429 raft_consensus.cc:374] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:41.550865 10429 raft_consensus.cc:729] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ca0cadefc37484ab84fde2a382a7c3e, State: Initialized, Role: FOLLOWER
I20260811 16:47:41.550763 10434 raft_consensus.cc:348] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3f7a736f94b451087b9a344e2d7d202" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44303 } } peers { permanent_uuid: "3ca0cadefc37484ab84fde2a382a7c3e" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42663 } } peers { permanent_uuid: "e5a2b1805e7048c18e4236ac616f061d" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 40033 } }
I20260811 16:47:41.551012 10434 raft_consensus.cc:374] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:41.551097 10434 raft_consensus.cc:729] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5a2b1805e7048c18e4236ac616f061d, State: Initialized, Role: FOLLOWER
I20260811 16:47:41.551060 10429 consensus_queue.cc:260] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3f7a736f94b451087b9a344e2d7d202" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44303 } } peers { permanent_uuid: "3ca0cadefc37484ab84fde2a382a7c3e" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42663 } } peers { permanent_uuid: "e5a2b1805e7048c18e4236ac616f061d" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 40033 } }
I20260811 16:47:41.551247 10434 consensus_queue.cc:260] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3f7a736f94b451087b9a344e2d7d202" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44303 } } peers { permanent_uuid: "3ca0cadefc37484ab84fde2a382a7c3e" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42663 } } peers { permanent_uuid: "e5a2b1805e7048c18e4236ac616f061d" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 40033 } }
I20260811 16:47:41.551354 10429 ts_tablet_manager.cc:1428] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:47:41.551430 9988 heartbeater.cc:503] Master 127.2.55.190:39415 was elected leader, sending a full tablet report...
I20260811 16:47:41.551590 10434 ts_tablet_manager.cc:1428] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 16:47:41.551637 10404 heartbeater.cc:503] Master 127.2.55.190:39415 was elected leader, sending a full tablet report...
I20260811 16:47:41.592654 10440 raft_consensus.cc:482] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:41.592782 10440 raft_consensus.cc:504] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3f7a736f94b451087b9a344e2d7d202" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44303 } } peers { permanent_uuid: "3ca0cadefc37484ab84fde2a382a7c3e" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42663 } } peers { permanent_uuid: "e5a2b1805e7048c18e4236ac616f061d" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 40033 } }
I20260811 16:47:41.593147 10440 leader_election.cc:288] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3f7a736f94b451087b9a344e2d7d202 (127.2.55.130:44303), e5a2b1805e7048c18e4236ac616f061d (127.2.55.131:40033)
I20260811 16:47:41.594902 9994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.593393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:40033 (local address 127.2.55.129:45309)
0811 16:47:41.593457 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:41.593470 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:41.593526 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:41.593783 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:41.593784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:41.593788 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:41.594421 (+ 633us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:47:41.594422 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:41.594432 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:47:41.594472 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:41.594722 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:41.594723 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:41.594724 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:47:41.594794 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 16:47:41.594810 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 16:47:41.594964 10422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.593541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:45309 (local address 127.2.55.131:40033)
0811 16:47:41.593614 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:41.593616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:41.593625 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:41.593656 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:41.593658 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:41.593664 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:41.593732 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:41.594593 (+ 861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:41.594595 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:41.594596 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:47:41.594601 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:41.594620 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:47:41.594627 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:41.594696 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:41.594826 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 16:47:41.594866 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:47:41.595067 10443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.593393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:44303 (local address 127.2.55.129:48499)
0811 16:47:41.593634 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:41.593644 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:41.593710 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:41.593895 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:41.593896 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:41.593914 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:41.594650 (+ 736us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:47:41.594651 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:41.594658 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:47:41.594671 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:41.594893 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:41.594894 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:41.594895 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:47:41.594955 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 16:47:41.594969 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":24,"thread_start_us":116,"threads_started":1}
I20260811 16:47:41.595172 10423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.593549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:48499 (local address 127.2.55.130:44303)
0811 16:47:41.593596 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:41.593599 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:41.593754 (+ 155us) server_negotiation.cc:407] Connection header received
0811 16:47:41.593788 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:41.593789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:41.593797 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:41.593884 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:41.594772 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:41.594773 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:41.594773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:47:41.594779 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:41.594800 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:47:41.594806 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:41.594872 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:41.595063 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 16:47:41.595081 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:47:41.595353 10330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abc98f3b4cba44b9b07269f1f0c72489" candidate_uuid: "3ca0cadefc37484ab84fde2a382a7c3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5a2b1805e7048c18e4236ac616f061d" is_pre_election: true
I20260811 16:47:41.595466 10121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abc98f3b4cba44b9b07269f1f0c72489" candidate_uuid: "3ca0cadefc37484ab84fde2a382a7c3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3f7a736f94b451087b9a344e2d7d202" is_pre_election: true
I20260811 16:47:41.595515 10330 raft_consensus.cc:2454] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ca0cadefc37484ab84fde2a382a7c3e in term 0.
I20260811 16:47:41.595613 10121 raft_consensus.cc:2454] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ca0cadefc37484ab84fde2a382a7c3e in term 0.
I20260811 16:47:41.595784 9819 leader_election.cc:302] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ca0cadefc37484ab84fde2a382a7c3e, e5a2b1805e7048c18e4236ac616f061d; no voters:
I20260811 16:47:41.595969 10440 raft_consensus.cc:2781] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:41.596042 10440 raft_consensus.cc:482] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:41.596063 10440 raft_consensus.cc:3037] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:41.596814 10440 raft_consensus.cc:504] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3f7a736f94b451087b9a344e2d7d202" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44303 } } peers { permanent_uuid: "3ca0cadefc37484ab84fde2a382a7c3e" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42663 } } peers { permanent_uuid: "e5a2b1805e7048c18e4236ac616f061d" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 40033 } }
I20260811 16:47:41.597045 10440 leader_election.cc:288] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [CANDIDATE]: Term 1 election: Requested vote from peers f3f7a736f94b451087b9a344e2d7d202 (127.2.55.130:44303), e5a2b1805e7048c18e4236ac616f061d (127.2.55.131:40033)
I20260811 16:47:41.597182 10121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abc98f3b4cba44b9b07269f1f0c72489" candidate_uuid: "3ca0cadefc37484ab84fde2a382a7c3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3f7a736f94b451087b9a344e2d7d202"
I20260811 16:47:41.597234 10330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abc98f3b4cba44b9b07269f1f0c72489" candidate_uuid: "3ca0cadefc37484ab84fde2a382a7c3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5a2b1805e7048c18e4236ac616f061d"
I20260811 16:47:41.597277 10121 raft_consensus.cc:3037] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:41.597301 10330 raft_consensus.cc:3037] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:41.598194 10121 raft_consensus.cc:2454] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ca0cadefc37484ab84fde2a382a7c3e in term 1.
I20260811 16:47:41.598207 10330 raft_consensus.cc:2454] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ca0cadefc37484ab84fde2a382a7c3e in term 1.
I20260811 16:47:41.598402 9819 leader_election.cc:302] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ca0cadefc37484ab84fde2a382a7c3e, e5a2b1805e7048c18e4236ac616f061d; no voters:
I20260811 16:47:41.598507 10440 raft_consensus.cc:2781] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:41.598685 10440 raft_consensus.cc:686] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [term 1 LEADER]: Becoming Leader. State: Replica: 3ca0cadefc37484ab84fde2a382a7c3e, State: Running, Role: LEADER
I20260811 16:47:41.598794 10440 consensus_queue.cc:237] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3f7a736f94b451087b9a344e2d7d202" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44303 } } peers { permanent_uuid: "3ca0cadefc37484ab84fde2a382a7c3e" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42663 } } peers { permanent_uuid: "e5a2b1805e7048c18e4236ac616f061d" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 40033 } }
I20260811 16:47:41.599731 9696 catalog_manager.cc:5495] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ca0cadefc37484ab84fde2a382a7c3e (127.2.55.129). New cstate: current_term: 1 leader_uuid: "3ca0cadefc37484ab84fde2a382a7c3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3f7a736f94b451087b9a344e2d7d202" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ca0cadefc37484ab84fde2a382a7c3e" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5a2b1805e7048c18e4236ac616f061d" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 40033 } health_report { overall_health: UNKNOWN } } }
I20260811 16:47:41.613641 10427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.612571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35092 (local address 127.2.55.129:42663)
0811 16:47:41.612630 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:41.612632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:41.612639 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:47:41.612671 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:41.612672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:41.612682 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:41.612731 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:41.613360 (+ 629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:41.613360 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:41.613361 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:47:41.613364 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:41.613377 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:47:41.613381 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:41.613429 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:41.613476 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 16:47:41.613487 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:47:41.615403 10121 raft_consensus.cc:1261] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202 [term 1 FOLLOWER]: Refusing update from remote peer 3ca0cadefc37484ab84fde2a382a7c3e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:41.615403 10330 raft_consensus.cc:1261] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d [term 1 FOLLOWER]: Refusing update from remote peer 3ca0cadefc37484ab84fde2a382a7c3e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:41.615753 10440 consensus_queue.cc:1035] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3f7a736f94b451087b9a344e2d7d202" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:41.615898 10445 consensus_queue.cc:1035] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5a2b1805e7048c18e4236ac616f061d" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 40033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:41.620476 10450 mvcc.cc:205] Tried to move back new op lower bound from 7317368265174016000 to 7317368265109393408. Current Snapshot: MvccSnapshot[applied={T|T < 7317368265174016000}]
I20260811 16:47:41.620716 10452 mvcc.cc:205] Tried to move back new op lower bound from 7317368265174016000 to 7317368265109393408. Current Snapshot: MvccSnapshot[applied={T|T < 7317368265174016000}]
I20260811 16:47:41.621837 10453 mvcc.cc:205] Tried to move back new op lower bound from 7317368265174016000 to 7317368265109393408. Current Snapshot: MvccSnapshot[applied={T|T < 7317368265174016000}]
I20260811 16:47:41.623005 9696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:41.623098 9696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:41.623834 9696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a1cfaca66e8648e9a04108c7db78b64c: Sending DeleteTablet for 3 replicas of tablet abc98f3b4cba44b9b07269f1f0c72489
I20260811 16:47:41.624267 10092 tablet_service.cc:1514] Processing DeleteTablet for tablet abc98f3b4cba44b9b07269f1f0c72489 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:41 UTC) from {username='slave'} at 127.0.0.1:43876
I20260811 16:47:41.624264 10298 tablet_service.cc:1514] Processing DeleteTablet for tablet abc98f3b4cba44b9b07269f1f0c72489 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:41 UTC) from {username='slave'} at 127.0.0.1:50262
I20260811 16:47:41.624308 9891 tablet_service.cc:1514] Processing DeleteTablet for tablet abc98f3b4cba44b9b07269f1f0c72489 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:41 UTC) from {username='slave'} at 127.0.0.1:35084
I20260811 16:47:41.624598 10467 tablet_replica.cc:330] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202: stopping tablet replica
I20260811 16:47:41.624544 10471 tablet_replica.cc:330] T abc98f3b4cba44b9b07269f1f0c72489 P 3ca0cadefc37484ab84fde2a382a7c3e: stopping tablet replica
I20260811 16:47:41.624745 10467 raft_consensus.cc:2229] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:41.624756 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 9788
I20260811 16:47:41.634521 10468 tablet_replica.cc:330] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d: stopping tablet replica
I20260811 16:47:41.634716 10468 raft_consensus.cc:2229] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:41.634897 10468 raft_consensus.cc:2258] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:41.635818 10468 ts_tablet_manager.cc:1905] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:41.637841 10468 ts_tablet_manager.cc:1918] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:41.637945 10468 log.cc:1196] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/abc98f3b4cba44b9b07269f1f0c72489
I20260811 16:47:41.638200 10468 ts_tablet_manager.cc:1939] T abc98f3b4cba44b9b07269f1f0c72489 P e5a2b1805e7048c18e4236ac616f061d: Deleting consensus metadata
I20260811 16:47:41.638651 9675 catalog_manager.cc:4841] TS e5a2b1805e7048c18e4236ac616f061d (127.2.55.131:40033): tablet abc98f3b4cba44b9b07269f1f0c72489 (table test-table [id=9757c45d2f624ebaaca7b4bb178df2ab]) successfully deleted
I20260811 16:47:41.639209 10467 raft_consensus.cc:2258] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:41.640333 10467 ts_tablet_manager.cc:1905] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:41.642076 10467 ts_tablet_manager.cc:1918] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:41.642143 10467 log.cc:1196] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/abc98f3b4cba44b9b07269f1f0c72489
I20260811 16:47:41.642412 10467 ts_tablet_manager.cc:1939] T abc98f3b4cba44b9b07269f1f0c72489 P f3f7a736f94b451087b9a344e2d7d202: Deleting consensus metadata
I20260811 16:47:41.642930 9673 catalog_manager.cc:4841] TS f3f7a736f94b451087b9a344e2d7d202 (127.2.55.130:44303): tablet abc98f3b4cba44b9b07269f1f0c72489 (table test-table [id=9757c45d2f624ebaaca7b4bb178df2ab]) successfully deleted
W20260811 16:47:41.644797 9673 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.55.129:42663 (error 108)
I20260811 16:47:41.644954 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 9995
I20260811 16:47:41.653232 10421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.653051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:42663 (local address 127.0.0.1:35102)
0811 16:47:41.653132 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:41.653195 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:42663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 16:47:41.653381 9673 catalog_manager.cc:4584] TS 3ca0cadefc37484ab84fde2a382a7c3e (127.2.55.129:42663): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet abc98f3b4cba44b9b07269f1f0c72489: Network error: Client connection negotiation failed: client connection to 127.2.55.129:42663: connect: Connection refused (error 111)
I20260811 16:47:41.654814 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 10200
I20260811 16:47:41.662984 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 9649
2026-08-11T16:47:41Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (686 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 16:47:41.688611 2270 mini_oidc.cc:152] Starting JWKS server
I20260811 16:47:41.689929 2270 webserver.cc:460] Webserver started at https://127.0.0.1:46275/ using document root <none> and password file <none>
I20260811 16:47:41.690059 2270 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 16:47:41.690251 2270 webserver.cc:460] Webserver started at http://127.0.0.1:42421/ using document root <none> and password file <none>
2026-08-11T16:47:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:41Z Disabled control of system clock
I20260811 16:47:41.699635 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:46205
--webserver_interface=127.2.55.190
--webserver_port=0
--builtin_ntp_servers=127.2.55.148:36617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:46205
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46275/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/testchainca.cert with env {}
W20260811 16:47:41.781873 10489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:41.782083 10489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:41.782106 10489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:41.783334 10489 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:41.783404 10489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:41.783427 10489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:41.783452 10489 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:41.783473 10489 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 16:47:41.783493 10489 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 16:47:41.783505 10489 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46275/jwks.json
I20260811 16:47:41.785073 10489 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:46205
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:46205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46275/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:41.785269 10489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:41.785434 10489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:41.790762 10498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:41.790783 10495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:41.790822 10494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:41.791249 10489 server_base.cc:1034] running on GCE node
I20260811 16:47:41.791498 10489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:41.791796 10489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:41.792958 10489 hybrid_clock.cc:648] HybridClock initialized: now 1786466861792925 us; error 54 us; skew 500 ppm
I20260811 16:47:41.794265 10489 webserver.cc:460] Webserver started at http://127.2.55.190:37379/ using document root <none> and password file <none>
I20260811 16:47:41.794521 10489 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:41.794598 10489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:41.794739 10489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:41.795753 10489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "abf59a93447746898514ef4ff7d6f263"
format_stamp: "Formatted at 2026-08-11 16:47:41 on dist-test-slave-3h5h"
server_key: "7f83749824ac94e7eb85cd029f0874de"
server_key_iv: "b388664932fc42810fa027a07784b362"
server_key_version: "encryptionkey@0"
I20260811 16:47:41.796186 10489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "abf59a93447746898514ef4ff7d6f263"
format_stamp: "Formatted at 2026-08-11 16:47:41 on dist-test-slave-3h5h"
server_key: "7f83749824ac94e7eb85cd029f0874de"
server_key_iv: "b388664932fc42810fa027a07784b362"
server_key_version: "encryptionkey@0"
I20260811 16:47:41.797698 10489 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:41.798540 10511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:41.798728 10489 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:41.798832 10489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "abf59a93447746898514ef4ff7d6f263"
format_stamp: "Formatted at 2026-08-11 16:47:41 on dist-test-slave-3h5h"
server_key: "7f83749824ac94e7eb85cd029f0874de"
server_key_iv: "b388664932fc42810fa027a07784b362"
server_key_version: "encryptionkey@0"
I20260811 16:47:41.798903 10489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:41.807639 10489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:41.807942 10489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:41.808099 10489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:41.812354 10489 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:46205
I20260811 16:47:41.812390 10599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:46205 every 8 connection(s)
I20260811 16:47:41.812777 10489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:41.813884 10600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:41.813968 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 10489
I20260811 16:47:41.814075 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:41.814248 2270 external_mini_cluster.cc:1428] Setting key 55a95eb20e86becdc1afe728b5225ef4
I20260811 16:47:41.817905 10600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263: Bootstrap starting.
I20260811 16:47:41.818691 10600 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:41.819039 10600 log.cc:824] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:41.819916 10600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263: No bootstrap required, opened a new log
I20260811 16:47:41.821053 10605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.814808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36332 (local address 127.2.55.190:46205)
0811 16:47:41.815047 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:41.815057 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:41.815094 (+ 37us) server_negotiation.cc:407] Connection header received
0811 16:47:41.815836 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:41.815847 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:41.815936 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:41.816108 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:41.816340 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:41.817845 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:41.818654 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:41.819350 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:41.819451 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:41.820238 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:41.820242 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:41.820242 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:47:41.820461 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:41.820529 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:47:41.820546 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:41.820622 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:41.820685 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 16:47:41.820770 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":101,"threads_started":1}
I20260811 16:47:41.822026 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:47:41.822679 10600 raft_consensus.cc:348] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf59a93447746898514ef4ff7d6f263" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 46205 } }
I20260811 16:47:41.822867 10600 raft_consensus.cc:374] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:41.822906 10600 raft_consensus.cc:729] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf59a93447746898514ef4ff7d6f263, State: Initialized, Role: FOLLOWER
I20260811 16:47:41.823096 10600 consensus_queue.cc:260] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf59a93447746898514ef4ff7d6f263" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 46205 } }
I20260811 16:47:41.823189 10600 raft_consensus.cc:388] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:41.823213 10600 raft_consensus.cc:482] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:41.823244 10600 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:41.823777 10600 raft_consensus.cc:504] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf59a93447746898514ef4ff7d6f263" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 46205 } }
I20260811 16:47:41.823865 10600 leader_election.cc:302] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abf59a93447746898514ef4ff7d6f263; no voters:
I20260811 16:47:41.824007 10600 leader_election.cc:288] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:41.824095 10607 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:41.824249 10607 raft_consensus.cc:686] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [term 1 LEADER]: Becoming Leader. State: Replica: abf59a93447746898514ef4ff7d6f263, State: Running, Role: LEADER
I20260811 16:47:41.824342 10607 consensus_queue.cc:237] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf59a93447746898514ef4ff7d6f263" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 46205 } }
I20260811 16:47:41.824479 10600 sys_catalog.cc:564] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:41.824664 10607 sys_catalog.cc:455] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abf59a93447746898514ef4ff7d6f263" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf59a93447746898514ef4ff7d6f263" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 46205 } } }
I20260811 16:47:41.824681 10608 sys_catalog.cc:455] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abf59a93447746898514ef4ff7d6f263. Latest consensus state: current_term: 1 leader_uuid: "abf59a93447746898514ef4ff7d6f263" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf59a93447746898514ef4ff7d6f263" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 46205 } } }
I20260811 16:47:41.824868 10607 sys_catalog.cc:458] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:41.824887 10608 sys_catalog.cc:458] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:41.825389 10616 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:41.825894 10616 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:41.827683 10616 catalog_manager.cc:1347] Generated new cluster ID: 9153d3c0e6b84c6abb8f410f5ae11033
I20260811 16:47:41.827740 10616 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:47:41.848263 10616 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:41.848943 10616 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:41.852486 10616 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abf59a93447746898514ef4ff7d6f263: Generated new TSK 0
I20260811 16:47:41.852699 10616 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 16:47:41.886620 10641 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 16:47:41.886795 10641 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 16:47:41.886992 10605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:41.870680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36346 (local address 127.2.55.190:46205)
0811 16:47:41.870748 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:41.870750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:41.870899 (+ 149us) server_negotiation.cc:407] Connection header received
0811 16:47:41.871006 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:41.871008 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:41.871021 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:41.871103 (+ 82us) server_negotiation.cc:226] Negotiated authn=JWT
0811 16:47:41.871260 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:41.872055 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:41.873092 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:41.873418 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:41.873492 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:41.873737 (+ 245us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 16:47:41.886731 (+ 12994us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46275/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 16:47:41.886919 (+ 188us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36346: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46275/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 16:47:41.887070 10605 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36346: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46275/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 16:47:41.887607 10640 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:41.870587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:46205 (local address 127.0.0.1:36346)
0811 16:47:41.870824 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:41.870835 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:41.870911 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:41.871121 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:41.871122 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:41.871124 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 16:47:41.871189 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:41.871190 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:41.872166 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:41.872167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:41.872827 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:41.872829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:41.873523 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:41.873525 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:41.873581 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:41.873604 (+ 23us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 16:47:41.886973 (+ 13369us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46275/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 16:47:41.887235 (+ 262us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.2.55.190:46205: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46275/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":118,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.2.55.190:46205: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46275/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 16:47:41.888250 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 10489
2026-08-11T16:47:41Z chronyd exiting
I20260811 16:47:41.939599 2270 test_util.cc:175] -----------------------------------------------
I20260811 16:47:41.939729 2270 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466835675343-2270-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (252 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 16:47:41.940794 2270 mini_oidc.cc:152] Starting JWKS server
I20260811 16:47:41.941637 2270 webserver.cc:460] Webserver started at https://127.0.0.1:41395/ using document root <none> and password file <none>
I20260811 16:47:41.941716 2270 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 16:47:41.941916 2270 webserver.cc:460] Webserver started at http://127.0.0.1:37335/ using document root <none> and password file <none>
2026-08-11T16:47:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:41Z Disabled control of system clock
I20260811 16:47:41.952471 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:39751
--webserver_interface=127.2.55.190
--webserver_port=0
--builtin_ntp_servers=127.2.55.148:42911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:39751
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41395/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/testchainca.cert with env {}
W20260811 16:47:42.056953 10652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:42.057235 10652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:42.057274 10652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:42.059247 10652 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:42.059340 10652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:42.059362 10652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:42.059384 10652 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:42.059451 10652 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 16:47:42.059482 10652 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 16:47:42.059497 10652 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41395/jwks.json
I20260811 16:47:42.061602 10652 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:42911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:39751
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:39751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41395/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:42.061931 10652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:42.062335 10652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:42.069387 10666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:42.069388 10663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:42.069572 10659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:42.072527 10652 server_base.cc:1034] running on GCE node
I20260811 16:47:42.072913 10652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:42.073311 10652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:42.074481 10652 hybrid_clock.cc:648] HybridClock initialized: now 1786466862074456 us; error 48 us; skew 500 ppm
I20260811 16:47:42.076319 10652 webserver.cc:460] Webserver started at http://127.2.55.190:39961/ using document root <none> and password file <none>
I20260811 16:47:42.076656 10652 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:42.076741 10652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:42.076928 10652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:42.078740 10652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "73375aec3623435887868e2758cd6c56"
format_stamp: "Formatted at 2026-08-11 16:47:42 on dist-test-slave-3h5h"
server_key: "7d75e20ebeb9a68e034e0abddb6837de"
server_key_iv: "b53a3e456d0089097e98b6c2f23f7189"
server_key_version: "encryptionkey@0"
I20260811 16:47:42.079312 10652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "73375aec3623435887868e2758cd6c56"
format_stamp: "Formatted at 2026-08-11 16:47:42 on dist-test-slave-3h5h"
server_key: "7d75e20ebeb9a68e034e0abddb6837de"
server_key_iv: "b53a3e456d0089097e98b6c2f23f7189"
server_key_version: "encryptionkey@0"
I20260811 16:47:42.081634 10652 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 16:47:42.082743 10673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:42.082955 10652 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:42.083206 10652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "73375aec3623435887868e2758cd6c56"
format_stamp: "Formatted at 2026-08-11 16:47:42 on dist-test-slave-3h5h"
server_key: "7d75e20ebeb9a68e034e0abddb6837de"
server_key_iv: "b53a3e456d0089097e98b6c2f23f7189"
server_key_version: "encryptionkey@0"
I20260811 16:47:42.083313 10652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:42.102202 10652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:42.102607 10652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:42.102787 10652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:42.107422 10652 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:39751
I20260811 16:47:42.107456 10752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:39751 every 8 connection(s)
I20260811 16:47:42.107865 10652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:42.108393 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 10652
I20260811 16:47:42.108487 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:42.108723 2270 external_mini_cluster.cc:1428] Setting key 575fc82494938ca429642097f1421df4
I20260811 16:47:42.109377 10753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:42.113512 10753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56: Bootstrap starting.
I20260811 16:47:42.114355 10753 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:42.114691 10753 log.cc:824] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:42.115640 10753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56: No bootstrap required, opened a new log
I20260811 16:47:42.116647 10756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:42.109685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49980 (local address 127.2.55.190:39751)
0811 16:47:42.109972 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:42.109982 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:42.110018 (+ 36us) server_negotiation.cc:407] Connection header received
0811 16:47:42.110725 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:42.110736 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:42.110831 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:42.111001 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:42.111313 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.112902 (+ 1589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.114085 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.114775 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.114911 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:42.115876 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:42.115881 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:42.115881 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:47:42.116096 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:42.116134 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:47:42.116147 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:42.116236 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:42.116326 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 16:47:42.116415 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":109,"threads_started":1}
I20260811 16:47:42.117825 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:47:42.118120 10753 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73375aec3623435887868e2758cd6c56" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39751 } }
I20260811 16:47:42.118283 10753 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:42.118332 10753 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73375aec3623435887868e2758cd6c56, State: Initialized, Role: FOLLOWER
I20260811 16:47:42.118468 10753 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73375aec3623435887868e2758cd6c56" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39751 } }
I20260811 16:47:42.118561 10753 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:42.118602 10753 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:42.118644 10753 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:42.119314 10753 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73375aec3623435887868e2758cd6c56" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39751 } }
I20260811 16:47:42.119439 10753 leader_election.cc:302] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73375aec3623435887868e2758cd6c56; no voters:
I20260811 16:47:42.119621 10753 leader_election.cc:288] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:42.119679 10761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:42.119875 10753 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:42.119879 10761 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [term 1 LEADER]: Becoming Leader. State: Replica: 73375aec3623435887868e2758cd6c56, State: Running, Role: LEADER
I20260811 16:47:42.120095 10761 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73375aec3623435887868e2758cd6c56" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39751 } }
I20260811 16:47:42.120579 10762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73375aec3623435887868e2758cd6c56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73375aec3623435887868e2758cd6c56" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39751 } } }
I20260811 16:47:42.120591 10763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73375aec3623435887868e2758cd6c56. Latest consensus state: current_term: 1 leader_uuid: "73375aec3623435887868e2758cd6c56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73375aec3623435887868e2758cd6c56" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39751 } } }
I20260811 16:47:42.120699 10762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:42.120707 10763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56 [sys.catalog]: This master's current role is: LEADER
W20260811 16:47:42.122021 10794 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:47:42.122119 10794 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:47:42.122195 10778 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:42.122447 10778 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:42.124037 10778 catalog_manager.cc:1347] Generated new cluster ID: 5a41ceb81859447c8e30b566e91b98ef
I20260811 16:47:42.124142 10778 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:47:42.132484 10778 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:42.133246 10778 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:42.139146 10778 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73375aec3623435887868e2758cd6c56: Generated new TSK 0
I20260811 16:47:42.139364 10778 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 16:47:42.172005 10808 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 16:47:42.172124 10808 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 16:47:42.172451 10756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:42.150153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49992 (local address 127.2.55.190:39751)
0811 16:47:42.150218 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:42.150221 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:42.150320 (+ 99us) server_negotiation.cc:407] Connection header received
0811 16:47:42.150404 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:42.150405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:42.150417 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:42.150481 (+ 64us) server_negotiation.cc:226] Negotiated authn=JWT
0811 16:47:42.150632 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.151144 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.152279 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.152469 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.152525 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:42.152723 (+ 198us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 16:47:42.172210 (+ 19487us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41395/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 16:47:42.172394 (+ 184us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49992: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41395/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":36}
W20260811 16:47:42.172561 10756 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49992: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41395/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 16:47:42.172593 10806 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:42.150071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39751 (local address 127.0.0.1:49992)
0811 16:47:42.150243 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:42.150255 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:42.150327 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:42.150500 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:42.150501 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:42.150503 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 16:47:42.150565 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:42.150568 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.151225 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.151226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:42.152192 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:42.152196 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.152547 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.152548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:42.152619 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:42.152624 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 16:47:42.172365 (+ 19741us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41395/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 16:47:42.172495 (+ 130us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.2.55.190:39751: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41395/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":107,"threads_started":1}
I20260811 16:47:42.173092 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 10652
2026-08-11T16:47:42Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (276 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 16:47:42.217551 2270 mini_oidc.cc:152] Starting JWKS server
I20260811 16:47:42.218211 2270 webserver.cc:460] Webserver started at https://127.0.0.1:42651/ using document root <none> and password file <none>
I20260811 16:47:42.218283 2270 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 16:47:42.218441 2270 webserver.cc:460] Webserver started at http://127.0.0.1:45373/ using document root <none> and password file <none>
2026-08-11T16:47:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:42Z Disabled control of system clock
I20260811 16:47:42.227869 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:43041
--webserver_interface=127.2.55.190
--webserver_port=0
--builtin_ntp_servers=127.2.55.148:40765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:43041
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42651/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 16:47:42.311151 10816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:42.311350 10816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:42.311372 10816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:42.312532 10816 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:42.312574 10816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:42.312587 10816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:42.312599 10816 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:42.312611 10816 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 16:47:42.312664 10816 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 16:47:42.312681 10816 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42651/jwks.json
I20260811 16:47:42.314100 10816 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:40765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:43041
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:43041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42651/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:42.314357 10816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:42.314656 10816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:42.319818 10822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:42.319918 10823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:42.319929 10826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:42.319984 10816 server_base.cc:1034] running on GCE node
I20260811 16:47:42.320394 10816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:42.320695 10816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:42.321858 10816 hybrid_clock.cc:648] HybridClock initialized: now 1786466862321844 us; error 48 us; skew 500 ppm
I20260811 16:47:42.323082 10816 webserver.cc:460] Webserver started at http://127.2.55.190:45065/ using document root <none> and password file <none>
I20260811 16:47:42.323345 10816 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:42.323413 10816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:42.323576 10816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:42.324746 10816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "bdfbc7d0254e4ac49e3f2ee139f58883"
format_stamp: "Formatted at 2026-08-11 16:47:42 on dist-test-slave-3h5h"
server_key: "e9ea0756b514e6aff9abc480525f04f3"
server_key_iv: "df89d6fb8e22770149896cc27b253867"
server_key_version: "encryptionkey@0"
I20260811 16:47:42.325230 10816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "bdfbc7d0254e4ac49e3f2ee139f58883"
format_stamp: "Formatted at 2026-08-11 16:47:42 on dist-test-slave-3h5h"
server_key: "e9ea0756b514e6aff9abc480525f04f3"
server_key_iv: "df89d6fb8e22770149896cc27b253867"
server_key_version: "encryptionkey@0"
I20260811 16:47:42.326797 10816 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:47:42.327736 10834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:42.327922 10816 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:42.328039 10816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "bdfbc7d0254e4ac49e3f2ee139f58883"
format_stamp: "Formatted at 2026-08-11 16:47:42 on dist-test-slave-3h5h"
server_key: "e9ea0756b514e6aff9abc480525f04f3"
server_key_iv: "df89d6fb8e22770149896cc27b253867"
server_key_version: "encryptionkey@0"
I20260811 16:47:42.328136 10816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:42.343883 10816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:42.344328 10816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:42.344538 10816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:42.349764 10816 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:43041
I20260811 16:47:42.349833 10910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:43041 every 8 connection(s)
I20260811 16:47:42.350195 10816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:42.350963 10913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:42.352772 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 10816
I20260811 16:47:42.352901 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:42.353122 2270 external_mini_cluster.cc:1428] Setting key c3c02d7c9f3ecc85d381eeaa78752ed9
I20260811 16:47:42.354293 10913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883: Bootstrap starting.
I20260811 16:47:42.354967 10913 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:42.355296 10913 log.cc:824] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:42.356171 10913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883: No bootstrap required, opened a new log
I20260811 16:47:42.358649 10913 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdfbc7d0254e4ac49e3f2ee139f58883" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43041 } }
I20260811 16:47:42.358837 10913 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:42.358886 10913 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdfbc7d0254e4ac49e3f2ee139f58883, State: Initialized, Role: FOLLOWER
I20260811 16:47:42.359027 10913 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdfbc7d0254e4ac49e3f2ee139f58883" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43041 } }
I20260811 16:47:42.359092 10913 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:42.359115 10913 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:42.359184 10913 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:42.359835 10917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:42.353728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53100 (local address 127.2.55.190:43041)
0811 16:47:42.353936 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:42.353945 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:42.353972 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:47:42.354637 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:42.354645 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:42.354715 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:42.354844 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:42.355176 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.356423 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.357572 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.358014 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.358117 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:42.358915 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:42.358942 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:42.358942 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:47:42.359286 (+ 344us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:42.359330 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:47:42.359343 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:42.359400 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:42.359506 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 16:47:42.359604 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260811 16:47:42.359876 10913 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdfbc7d0254e4ac49e3f2ee139f58883" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43041 } }
I20260811 16:47:42.359989 10913 leader_election.cc:302] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdfbc7d0254e4ac49e3f2ee139f58883; no voters:
I20260811 16:47:42.360179 10913 leader_election.cc:288] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:42.360213 10920 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:42.360402 10920 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [term 1 LEADER]: Becoming Leader. State: Replica: bdfbc7d0254e4ac49e3f2ee139f58883, State: Running, Role: LEADER
I20260811 16:47:42.360492 10920 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdfbc7d0254e4ac49e3f2ee139f58883" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43041 } }
I20260811 16:47:42.360528 10913 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:42.360942 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:47:42.362480 10921 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdfbc7d0254e4ac49e3f2ee139f58883" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdfbc7d0254e4ac49e3f2ee139f58883" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43041 } } }
I20260811 16:47:42.362581 10921 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [sys.catalog]: This master's current role is: LEADER
W20260811 16:47:42.362890 10943 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:47:42.362974 10943 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:47:42.362835 10922 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdfbc7d0254e4ac49e3f2ee139f58883. Latest consensus state: current_term: 1 leader_uuid: "bdfbc7d0254e4ac49e3f2ee139f58883" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdfbc7d0254e4ac49e3f2ee139f58883" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43041 } } }
I20260811 16:47:42.363109 10922 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:42.363252 10948 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:42.363440 10948 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:42.365005 10948 catalog_manager.cc:1347] Generated new cluster ID: e215ec1a166144bcb336288b386377d3
I20260811 16:47:42.365067 10948 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:47:42.390354 10948 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:42.391028 10948 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:42.399001 10948 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdfbc7d0254e4ac49e3f2ee139f58883: Generated new TSK 0
I20260811 16:47:42.399230 10948 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:47:42.419373 10917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:42.415357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53108 (local address 127.2.55.190:43041)
0811 16:47:42.415430 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:42.415432 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:42.415544 (+ 112us) server_negotiation.cc:407] Connection header received
0811 16:47:42.415610 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:42.415611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:42.415624 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:42.415708 (+ 84us) server_negotiation.cc:226] Negotiated authn=JWT
0811 16:47:42.415859 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.416634 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.417707 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.417996 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.418072 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:42.418245 (+ 173us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 16:47:42.419158 (+ 913us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42651/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 16:47:42.419296 (+ 138us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53108: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42651/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 16:47:42.419445 10917 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53108: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42651/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 16:47:42.421761 10961 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:42.415272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:43041 (local address 127.0.0.1:53108)
0811 16:47:42.415457 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:42.415469 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:42.415546 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:42.415721 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:42.415722 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:42.415724 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 16:47:42.415786 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:42.415788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.416751 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.416752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:42.417608 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:42.417611 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.418090 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.418091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:42.418142 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:42.418147 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 16:47:42.419291 (+ 1144us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42651/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 16:47:42.421642 (+ 2351us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.2.55.190:43041: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42651/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":2042,"thread_start_us":118,"threads_started":1}
I20260811 16:47:42.422024 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 10816
E20260811 16:47:42.453384 10965 webserver.cc:533] Webserver: sslize failed:
E20260811 16:47:42.453501 10965 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T16:47:42Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (269 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T16:47:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:42Z Disabled control of system clock
I20260811 16:47:42.496767 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:44171
--webserver_interface=127.2.55.190
--webserver_port=0
--builtin_ntp_servers=127.2.55.148:34021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:44171
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/testchainca.cert with env {}
W20260811 16:47:42.584072 10970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:42.584288 10970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:42.584312 10970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:42.585523 10970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:42.585568 10970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:42.585582 10970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:42.585593 10970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:42.585605 10970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 16:47:42.585618 10970 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 16:47:42.585629 10970 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 16:47:42.587208 10970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:34021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:44171
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:44171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:42.587426 10970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:42.587601 10970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:42.592850 10979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:42.592813 10978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:42.592815 10982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:42.593123 10970 server_base.cc:1034] running on GCE node
I20260811 16:47:42.593384 10970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:42.593714 10970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:42.594882 10970 hybrid_clock.cc:648] HybridClock initialized: now 1786466862594877 us; error 42 us; skew 500 ppm
I20260811 16:47:42.596155 10970 webserver.cc:460] Webserver started at http://127.2.55.190:34863/ using document root <none> and password file <none>
I20260811 16:47:42.596415 10970 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:42.596485 10970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:42.596661 10970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:42.597764 10970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "08c5209bd41d4138bacb2d12fdb78de2"
format_stamp: "Formatted at 2026-08-11 16:47:42 on dist-test-slave-3h5h"
server_key: "4035d9755835f9734da902b32bd5081f"
server_key_iv: "0ef2136055e8244e9bca2cb2b4deb144"
server_key_version: "encryptionkey@0"
I20260811 16:47:42.598194 10970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "08c5209bd41d4138bacb2d12fdb78de2"
format_stamp: "Formatted at 2026-08-11 16:47:42 on dist-test-slave-3h5h"
server_key: "4035d9755835f9734da902b32bd5081f"
server_key_iv: "0ef2136055e8244e9bca2cb2b4deb144"
server_key_version: "encryptionkey@0"
I20260811 16:47:42.599644 10970 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:47:42.600435 10993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:42.600630 10970 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:42.600739 10970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "08c5209bd41d4138bacb2d12fdb78de2"
format_stamp: "Formatted at 2026-08-11 16:47:42 on dist-test-slave-3h5h"
server_key: "4035d9755835f9734da902b32bd5081f"
server_key_iv: "0ef2136055e8244e9bca2cb2b4deb144"
server_key_version: "encryptionkey@0"
I20260811 16:47:42.600814 10970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:42.629271 10970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:42.629637 10970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:42.629793 10970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:42.634250 10970 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:44171
I20260811 16:47:42.634289 11079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:44171 every 8 connection(s)
I20260811 16:47:42.634673 10970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:42.635680 11080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:42.638164 11080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2: Bootstrap starting.
I20260811 16:47:42.638780 11080 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:42.639056 11080 log.cc:824] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:42.639773 11080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2: No bootstrap required, opened a new log
I20260811 16:47:42.641464 11080 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08c5209bd41d4138bacb2d12fdb78de2" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44171 } }
I20260811 16:47:42.641618 11080 raft_consensus.cc:374] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:42.641642 11080 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08c5209bd41d4138bacb2d12fdb78de2, State: Initialized, Role: FOLLOWER
I20260811 16:47:42.641786 11080 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08c5209bd41d4138bacb2d12fdb78de2" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44171 } }
I20260811 16:47:42.641866 11080 raft_consensus.cc:388] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:42.641912 11080 raft_consensus.cc:482] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:42.641968 11080 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:42.642114 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 10970
I20260811 16:47:42.642248 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:42.642452 2270 external_mini_cluster.cc:1428] Setting key 6a1ff35f721fd3596783289901ff2235
I20260811 16:47:42.642774 11080 raft_consensus.cc:504] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08c5209bd41d4138bacb2d12fdb78de2" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44171 } }
I20260811 16:47:42.642902 11080 leader_election.cc:302] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 08c5209bd41d4138bacb2d12fdb78de2; no voters:
I20260811 16:47:42.643069 11080 leader_election.cc:288] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:42.643224 11089 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:42.643330 11080 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:42.643390 11089 raft_consensus.cc:686] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [term 1 LEADER]: Becoming Leader. State: Replica: 08c5209bd41d4138bacb2d12fdb78de2, State: Running, Role: LEADER
I20260811 16:47:42.643477 11089 consensus_queue.cc:237] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08c5209bd41d4138bacb2d12fdb78de2" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44171 } }
I20260811 16:47:42.643915 11086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "08c5209bd41d4138bacb2d12fdb78de2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08c5209bd41d4138bacb2d12fdb78de2" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44171 } } }
I20260811 16:47:42.643996 11086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:42.644071 11091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08c5209bd41d4138bacb2d12fdb78de2. Latest consensus state: current_term: 1 leader_uuid: "08c5209bd41d4138bacb2d12fdb78de2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08c5209bd41d4138bacb2d12fdb78de2" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44171 } } }
I20260811 16:47:42.644155 11091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2 [sys.catalog]: This master's current role is: LEADER
W20260811 16:47:42.645426 11109 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:47:42.645535 11109 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:47:42.645608 11100 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:42.645789 11100 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:42.647488 11100 catalog_manager.cc:1347] Generated new cluster ID: be0f145ff0a04d2fb87a59a055039a20
I20260811 16:47:42.647544 11100 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:47:42.648542 11087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:42.642953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45230 (local address 127.2.55.190:44171)
0811 16:47:42.643228 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:42.643238 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:42.643274 (+ 36us) server_negotiation.cc:407] Connection header received
0811 16:47:42.643402 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:42.643409 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:42.643483 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:42.643879 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:42.643992 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.645406 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.646407 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.646897 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.647038 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:42.647828 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:42.647832 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:42.647833 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:47:42.648025 (+ 192us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:42.648065 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:47:42.648079 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:42.648145 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:42.648258 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 16:47:42.648334 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":87,"threads_started":1}
I20260811 16:47:42.649590 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:47:42.654273 11100 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:42.654742 11100 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:42.662999 11100 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 08c5209bd41d4138bacb2d12fdb78de2: Generated new TSK 0
I20260811 16:47:42.663200 11100 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:47:43.558838 11087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:42.673380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45240 (local address 127.2.55.190:44171)
0811 16:47:42.673425 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:42.673427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:42.673543 (+ 116us) server_negotiation.cc:407] Connection header received
0811 16:47:42.673628 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:42.673629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:42.673643 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:42.673756 (+ 113us) server_negotiation.cc:226] Negotiated authn=JWT
0811 16:47:42.673911 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.674473 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.675303 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.675511 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.675589 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:42.675781 (+ 192us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 16:47:43.558578 (+882797us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 16:47:43.558768 (+ 190us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45240: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 16:47:43.558946 11087 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45240: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 16:47:43.558961 11120 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:42.673269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:44171 (local address 127.0.0.1:45240)
0811 16:47:42.673463 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:42.673473 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:42.673563 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:42.673756 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:42.673757 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:42.673759 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 16:47:42.673823 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:42.673826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.674595 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.674596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:42.675196 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:42.675197 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:42.675589 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:42.675590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:42.675650 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:42.675655 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 16:47:43.558730 (+883075us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 16:47:43.558866 (+ 136us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.2.55.190:44171: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260811 16:47:43.559377 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 10970
2026-08-11T16:47:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1096 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (94 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (92 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:47:43 dist-test-slave-3h5h krb5kdc[11136](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:47:43 dist-test-slave-3h5h krb5kdc[11136](info): set up 2 sockets
Aug 11 16:47:43 dist-test-slave-3h5h krb5kdc[11136](info): commencing operation
krb5kdc: starting...
W20260811 16:47:45.027590 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:47:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:47:45.164902 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:42507
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:38893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:42507
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:45.248972 11155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:45.249235 11155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:45.249275 11155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:45.250478 11155 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:45.250550 11155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:45.250576 11155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:45.250594 11155 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:45.250620 11155 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:45.252153 11155 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:38893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:42507
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:42507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11155
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:45.252455 11155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:45.252698 11155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:45.257897 11165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:45.257892 11167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:45.258194 11155 server_base.cc:1034] running on GCE node
W20260811 16:47:45.257892 11169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:45.258553 11155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:45.258867 11155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:45.260047 11155 hybrid_clock.cc:648] HybridClock initialized: now 1786466865260041 us; error 40 us; skew 500 ppm
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:45.266319 11155 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:47:45.266819 11155 webserver.cc:460] Webserver started at http://127.2.55.190:45371/ using document root <none> and password file <none>
I20260811 16:47:45.267035 11155 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:45.267077 11155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:45.267190 11155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:45.268337 11155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "863994ea51b94a4396669a71e6530e43"
format_stamp: "Formatted at 2026-08-11 16:47:45 on dist-test-slave-3h5h"
server_key: "9ae1ff717df8d02d0210e03641341199"
server_key_iv: "1e66a01b32cbbf960f30ea0c7a0ebd58"
server_key_version: "encryptionkey@0"
I20260811 16:47:45.268698 11155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "863994ea51b94a4396669a71e6530e43"
format_stamp: "Formatted at 2026-08-11 16:47:45 on dist-test-slave-3h5h"
server_key: "9ae1ff717df8d02d0210e03641341199"
server_key_iv: "1e66a01b32cbbf960f30ea0c7a0ebd58"
server_key_version: "encryptionkey@0"
I20260811 16:47:45.270183 11155 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:45.270915 11186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:45.271126 11155 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:47:45.271240 11155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "863994ea51b94a4396669a71e6530e43"
format_stamp: "Formatted at 2026-08-11 16:47:45 on dist-test-slave-3h5h"
server_key: "9ae1ff717df8d02d0210e03641341199"
server_key_iv: "1e66a01b32cbbf960f30ea0c7a0ebd58"
server_key_version: "encryptionkey@0"
I20260811 16:47:45.271318 11155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:45.295230 11155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:45.298374 11155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:45.298558 11155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:45.304064 11155 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:42507
I20260811 16:47:45.304121 11256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:42507 every 8 connection(s)
I20260811 16:47:45.304527 11155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:45.305537 11258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:45.307988 11258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43: Bootstrap starting.
I20260811 16:47:45.308621 11258 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:45.308970 11258 log.cc:824] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:45.309697 11258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43: No bootstrap required, opened a new log
I20260811 16:47:45.310765 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 11155
I20260811 16:47:45.310858 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:45.311074 2270 external_mini_cluster.cc:1428] Setting key b0cbd55b57d2fa07283aca1c6b1e3bb3
I20260811 16:47:45.311812 11258 raft_consensus.cc:348] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "863994ea51b94a4396669a71e6530e43" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42507 } }
I20260811 16:47:45.312034 11258 raft_consensus.cc:374] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:45.312073 11258 raft_consensus.cc:729] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 863994ea51b94a4396669a71e6530e43, State: Initialized, Role: FOLLOWER
I20260811 16:47:45.312192 11258 consensus_queue.cc:260] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "863994ea51b94a4396669a71e6530e43" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42507 } }
I20260811 16:47:45.312284 11258 raft_consensus.cc:388] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:45.312317 11258 raft_consensus.cc:482] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:45.312417 11258 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:45.313170 11258 raft_consensus.cc:504] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "863994ea51b94a4396669a71e6530e43" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42507 } }
I20260811 16:47:45.313284 11258 leader_election.cc:302] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 863994ea51b94a4396669a71e6530e43; no voters:
I20260811 16:47:45.313441 11258 leader_election.cc:288] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:45.313517 11267 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:45.313689 11258 sys_catalog.cc:564] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:45.313740 11267 raft_consensus.cc:686] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [term 1 LEADER]: Becoming Leader. State: Replica: 863994ea51b94a4396669a71e6530e43, State: Running, Role: LEADER
I20260811 16:47:45.313946 11267 consensus_queue.cc:237] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "863994ea51b94a4396669a71e6530e43" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42507 } }
I20260811 16:47:45.314410 11268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "863994ea51b94a4396669a71e6530e43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "863994ea51b94a4396669a71e6530e43" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42507 } } }
I20260811 16:47:45.314505 11268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:45.314671 11269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 863994ea51b94a4396669a71e6530e43. Latest consensus state: current_term: 1 leader_uuid: "863994ea51b94a4396669a71e6530e43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "863994ea51b94a4396669a71e6530e43" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42507 } } }
I20260811 16:47:45.314730 11269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43 [sys.catalog]: This master's current role is: LEADER
W20260811 16:47:45.315637 11288 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:47:45.315697 11288 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:47:45.316119 11280 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:45.316318 11280 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:45.317945 11280 catalog_manager.cc:1347] Generated new cluster ID: b85bde10c65d49a792247d8437f1e67d
I20260811 16:47:45.318004 11280 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:45.323355 11265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:45.311690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33600 (local address 127.2.55.190:42507)
0811 16:47:45.311929 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:45.311940 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:45.311974 (+ 34us) server_negotiation.cc:407] Connection header received
0811 16:47:45.312090 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:45.312097 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:45.312153 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:45.312295 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:45.313163 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.314655 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.315803 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.316398 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.316514 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:45.319402 (+ 2888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:45.319407 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:45.319407 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:45.319420 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:45.321562 (+ 2142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:45.321976 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:45.321981 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:45.321982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:45.322146 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:45.322375 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:45.322376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:45.322377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:45.322730 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:45.322918 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:45.322988 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 16:47:45.323136 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":122,"threads_started":1}
I20260811 16:47:45.330832 11280 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:45.331527 11280 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:45.333400 11280 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 863994ea51b94a4396669a71e6530e43: Generated new TSK 0
I20260811 16:47:45.333580 11280 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:47:45.368546 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42507
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:38893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:45.453286 11296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:45.453541 11296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:45.453585 11296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:45.454851 11296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:45.454917 11296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:45.454962 11296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:47:45.456568 11296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:38893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:45.456880 11296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:45.457139 11296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:45.462833 11304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:45.462833 11311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:45.462862 11307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:45.462853 11296 server_base.cc:1034] running on GCE node
I20260811 16:47:45.463325 11296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:45.463599 11296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:45.464767 11296 hybrid_clock.cc:648] HybridClock initialized: now 1786466865464763 us; error 44 us; skew 500 ppm
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:45.467307 11296 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:47:45.467760 11296 webserver.cc:460] Webserver started at http://127.2.55.129:36613/ using document root <none> and password file <none>
I20260811 16:47:45.468016 11296 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:45.468092 11296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:45.468264 11296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:45.469486 11296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "40e4af10e9a24163bbd555c475ece400"
format_stamp: "Formatted at 2026-08-11 16:47:45 on dist-test-slave-3h5h"
server_key: "aff464fb0f8a71d54dc94cccbef263bf"
server_key_iv: "09fec850db5ac36d5894ab6aa15f65a5"
server_key_version: "encryptionkey@0"
I20260811 16:47:45.469866 11296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "40e4af10e9a24163bbd555c475ece400"
format_stamp: "Formatted at 2026-08-11 16:47:45 on dist-test-slave-3h5h"
server_key: "aff464fb0f8a71d54dc94cccbef263bf"
server_key_iv: "09fec850db5ac36d5894ab6aa15f65a5"
server_key_version: "encryptionkey@0"
I20260811 16:47:45.471284 11296 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:47:45.472059 11324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:45.472282 11296 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:45.472395 11296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "40e4af10e9a24163bbd555c475ece400"
format_stamp: "Formatted at 2026-08-11 16:47:45 on dist-test-slave-3h5h"
server_key: "aff464fb0f8a71d54dc94cccbef263bf"
server_key_iv: "09fec850db5ac36d5894ab6aa15f65a5"
server_key_version: "encryptionkey@0"
I20260811 16:47:45.472472 11296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:45.510007 11296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:45.512065 11296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:45.512246 11296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:45.512504 11296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:45.512871 11296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:45.512930 11296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:45.512974 11296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:45.513018 11296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:45.519392 11296 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:36311
I20260811 16:47:45.519443 11492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:36311 every 8 connection(s)
I20260811 16:47:45.519769 11296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:47:45.525221 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 11296
I20260811 16:47:45.525347 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:47:45.525557 2270 external_mini_cluster.cc:1428] Setting key 85de4ed125a05bff67e366e694d84995
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:45.529347 11265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:45.520532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:43045 (local address 127.2.55.190:42507)
0811 16:47:45.520613 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:45.520616 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:45.520796 (+ 180us) server_negotiation.cc:407] Connection header received
0811 16:47:45.521748 (+ 952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:45.521749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:45.521759 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:45.521804 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:45.522394 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.522892 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.523867 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.524060 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.524114 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:45.526509 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:45.526510 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:45.526511 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:45.526521 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:45.527922 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:45.528353 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:45.528355 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:45.528355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:45.528415 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:45.528678 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:45.528679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:45.528680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:45.528792 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:45.528900 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:45.529174 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 16:47:45.529256 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 16:47:45.529564 11498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:45.520496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:42507 (local address 127.2.55.129:43045)
0811 16:47:45.520653 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:45.520704 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:45.521632 (+ 928us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:45.521863 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:45.521866 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:45.522125 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:45.522323 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:45.522327 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.522974 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.522975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:45.523789 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:45.523791 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.524166 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.524167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:45.524280 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:45.524754 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:45.524762 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:45.526402 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:45.528025 (+ 1623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:45.528033 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:45.528036 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:45.528258 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:45.528485 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:45.528486 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:45.528486 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:45.528606 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:45.528890 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:45.528898 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:45.529038 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 16:47:45.529151 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 16:47:45.529309 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":79,"threads_started":1}
I20260811 16:47:45.530290 11494 heartbeater.cc:347] Connected to a master server at 127.2.55.190:42507
I20260811 16:47:45.530404 11494 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:45.530601 11494 heartbeater.cc:511] Master 127.2.55.190:42507 requested a full tablet report, sending...
I20260811 16:47:45.531188 11210 ts_manager.cc:194] Registered new tserver with Master: 40e4af10e9a24163bbd555c475ece400 (127.2.55.129:36311)
I20260811 16:47:45.531807 11210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:43045
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:47:45.555418 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42507
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:38893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:45.639189 11502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:45.639425 11502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:45.639463 11502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:45.640602 11502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:45.640671 11502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:45.640714 11502 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:47:45.642234 11502 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:38893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:45.642508 11502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:45.642746 11502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:45.648110 11510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:45.648202 11508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:45.648135 11515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:45.648367 11502 server_base.cc:1034] running on GCE node
I20260811 16:47:45.648661 11502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:45.648937 11502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:45.650082 11502 hybrid_clock.cc:648] HybridClock initialized: now 1786466865650070 us; error 29 us; skew 500 ppm
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:45.652578 11502 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:47:45.653103 11502 webserver.cc:460] Webserver started at http://127.2.55.130:43229/ using document root <none> and password file <none>
I20260811 16:47:45.653347 11502 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:45.653419 11502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:45.653599 11502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:45.654743 11502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "f22ebf51710e486bb27a00f3ad56c4a8"
format_stamp: "Formatted at 2026-08-11 16:47:45 on dist-test-slave-3h5h"
server_key: "6b1040a9d743a582b3ce2606ccf57c24"
server_key_iv: "ba5df7aab93314f19249bf1bf80d681e"
server_key_version: "encryptionkey@0"
I20260811 16:47:45.655112 11502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "f22ebf51710e486bb27a00f3ad56c4a8"
format_stamp: "Formatted at 2026-08-11 16:47:45 on dist-test-slave-3h5h"
server_key: "6b1040a9d743a582b3ce2606ccf57c24"
server_key_iv: "ba5df7aab93314f19249bf1bf80d681e"
server_key_version: "encryptionkey@0"
I20260811 16:47:45.656527 11502 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:45.657332 11526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:45.657488 11502 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:45.657600 11502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "f22ebf51710e486bb27a00f3ad56c4a8"
format_stamp: "Formatted at 2026-08-11 16:47:45 on dist-test-slave-3h5h"
server_key: "6b1040a9d743a582b3ce2606ccf57c24"
server_key_iv: "ba5df7aab93314f19249bf1bf80d681e"
server_key_version: "encryptionkey@0"
I20260811 16:47:45.657675 11502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:45.668216 11502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:45.670167 11502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:45.670333 11502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:45.670562 11502 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:45.670928 11502 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:45.670980 11502 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:45.671023 11502 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:45.671051 11502 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:45.677386 11502 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:35187
I20260811 16:47:45.677436 11700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:35187 every 8 connection(s)
I20260811 16:47:45.677747 11502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:47:45.681015 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 11502
I20260811 16:47:45.681118 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:47:45.681313 2270 external_mini_cluster.cc:1428] Setting key 413a6a83fd698fa899e40c2ce6df560e
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:45.688205 11265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:45.678466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:55851 (local address 127.2.55.190:42507)
0811 16:47:45.678514 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:45.678516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:45.678716 (+ 200us) server_negotiation.cc:407] Connection header received
0811 16:47:45.679625 (+ 909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:45.679627 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:45.679637 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:45.679697 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:45.680276 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.680775 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.682242 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.682425 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.682481 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:45.685264 (+ 2783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:45.685266 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:45.685266 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:45.685274 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:45.686663 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:45.687196 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:45.687197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:45.687197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:45.687249 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:45.687535 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:45.687535 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:45.687535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:45.687638 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:45.687690 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:45.688048 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 16:47:45.688118 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:47:45.688524 11703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:45.678415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:42507 (local address 127.2.55.130:55851)
0811 16:47:45.678581 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:45.678623 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:45.679530 (+ 907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:45.679750 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:45.679753 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:45.680005 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:45.680195 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:45.680199 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.680895 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.680896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:45.682145 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:45.682149 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.682509 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.682510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:45.682655 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:45.683148 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:45.683159 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:45.685156 (+ 1997us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:45.686764 (+ 1608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:45.686772 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:45.686775 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:45.687101 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:45.687318 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:45.687319 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:45.687320 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:45.687462 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:45.687706 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:45.687718 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:45.687897 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 16:47:45.688032 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 16:47:45.688231 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":91,"threads_started":1}
I20260811 16:47:45.689133 11701 heartbeater.cc:347] Connected to a master server at 127.2.55.190:42507
I20260811 16:47:45.689236 11701 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:45.689437 11701 heartbeater.cc:511] Master 127.2.55.190:42507 requested a full tablet report, sending...
I20260811 16:47:45.689851 11210 ts_manager.cc:194] Registered new tserver with Master: f22ebf51710e486bb27a00f3ad56c4a8 (127.2.55.130:35187)
I20260811 16:47:45.690188 11210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:55851
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:47:45.710088 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42507
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:38893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:45.793355 11707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:45.793613 11707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:45.793653 11707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:45.794823 11707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:45.794898 11707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:45.794945 11707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:47:45.796432 11707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:38893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:45.796723 11707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:45.796983 11707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:45.802050 11715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:45.802101 11718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:45.802047 11713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:45.802209 11707 server_base.cc:1034] running on GCE node
I20260811 16:47:45.802474 11707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:45.802685 11707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:45.803820 11707 hybrid_clock.cc:648] HybridClock initialized: now 1786466865803807 us; error 26 us; skew 500 ppm
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:45.806392 11707 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:47:45.806818 11707 webserver.cc:460] Webserver started at http://127.2.55.131:41119/ using document root <none> and password file <none>
I20260811 16:47:45.807011 11707 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:45.807052 11707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:45.807147 11707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:45.808182 11707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "76c0a9f3a6324491813837a1a8522d2b"
format_stamp: "Formatted at 2026-08-11 16:47:45 on dist-test-slave-3h5h"
server_key: "b4037b35f5b09cbeaf6e112ae29b17fe"
server_key_iv: "42c00055bd4cb572bf4c21aaa6558741"
server_key_version: "encryptionkey@0"
I20260811 16:47:45.808573 11707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "76c0a9f3a6324491813837a1a8522d2b"
format_stamp: "Formatted at 2026-08-11 16:47:45 on dist-test-slave-3h5h"
server_key: "b4037b35f5b09cbeaf6e112ae29b17fe"
server_key_iv: "42c00055bd4cb572bf4c21aaa6558741"
server_key_version: "encryptionkey@0"
I20260811 16:47:45.810124 11707 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:47:45.810804 11729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:45.811005 11707 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:47:45.811097 11707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "76c0a9f3a6324491813837a1a8522d2b"
format_stamp: "Formatted at 2026-08-11 16:47:45 on dist-test-slave-3h5h"
server_key: "b4037b35f5b09cbeaf6e112ae29b17fe"
server_key_iv: "42c00055bd4cb572bf4c21aaa6558741"
server_key_version: "encryptionkey@0"
I20260811 16:47:45.811151 11707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:45.830233 11707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:45.832540 11707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:45.832661 11707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:45.832904 11707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:45.833199 11707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:45.833266 11707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:45.833335 11707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:45.833384 11707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:45.839154 11707 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:45953
I20260811 16:47:45.839259 11917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:45953 every 8 connection(s)
I20260811 16:47:45.839581 11707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:47:45.845846 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 11707
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:45.845952 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:47:45.846143 2270 external_mini_cluster.cc:1428] Setting key 9e29511fdf9ab69485443b00c8b13dd4
I20260811 16:47:45.849390 11265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:45.840343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:42419 (local address 127.2.55.190:42507)
0811 16:47:45.840408 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:45.840410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:45.840609 (+ 199us) server_negotiation.cc:407] Connection header received
0811 16:47:45.841677 (+ 1068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:45.841679 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:45.841694 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:45.841743 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:45.842395 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.842907 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.843937 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.844173 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.844246 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:45.846472 (+ 2226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:45.846474 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:45.846475 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:45.846483 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:45.847909 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:45.848348 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:45.848349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:45.848350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:45.848413 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:45.848674 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:45.848675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:45.848675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:45.848805 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:45.848924 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:45.849216 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 16:47:45.849296 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:47:45.849591 11921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:45.840332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:42507 (local address 127.2.55.131:42419)
0811 16:47:45.840484 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:45.840522 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:45.841551 (+ 1029us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:45.841830 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:45.841833 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:45.842098 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:45.842293 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:45.842297 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.843022 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.843023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:45.843838 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:45.843840 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.844254 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.844255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:45.844396 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:45.844910 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:45.844919 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:45.846368 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:45.848014 (+ 1646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:45.848022 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:45.848024 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:45.848255 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:45.848488 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:45.848489 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:45.848489 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:45.848605 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:45.848917 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:45.848924 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:45.849069 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 16:47:45.849189 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 16:47:45.849355 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":70,"threads_started":1}
I20260811 16:47:45.850255 11919 heartbeater.cc:347] Connected to a master server at 127.2.55.190:42507
I20260811 16:47:45.850355 11919 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:45.850557 11919 heartbeater.cc:511] Master 127.2.55.190:42507 requested a full tablet report, sending...
I20260811 16:47:45.850941 11210 ts_manager.cc:194] Registered new tserver with Master: 76c0a9f3a6324491813837a1a8522d2b (127.2.55.131:45953)
I20260811 16:47:45.851333 11210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:42419
I20260811 16:47:45.857842 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/test-admin.keytab.
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:45.874743 2270 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 16:47:45.877116 11933 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:45.875796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56826 (local address 127.2.55.129:36311)
0811 16:47:45.876476 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:45.876484 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:45.876500 (+ 16us) server_negotiation.cc:407] Connection header received
0811 16:47:45.876528 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:45.876530 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:45.876545 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:45.876618 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:45.877004 (+ 386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56826: BlockingRecv error: recv got EOF from 127.0.0.1:56826 (error 108)
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":106,"threads_started":1}
W20260811 16:47:45.877245 2270 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/krb5cc' of type FILE
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:45.878273 2270 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:45.879172 2270 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.129@KRBTEST.COM
I20260811 16:47:45.886636 11933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:45.879714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56842 (local address 127.2.55.129:36311)
0811 16:47:45.879781 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:45.879783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:45.879813 (+ 30us) server_negotiation.cc:407] Connection header received
0811 16:47:45.879832 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:45.879833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:45.879842 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:45.879882 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:45.880275 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.881037 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.881730 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.882039 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.882091 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:45.884058 (+ 1967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:45.884066 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:45.884067 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:45.884073 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:45.885721 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:45.886013 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:45.886016 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:45.886016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:45.886069 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:45.886227 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:45.886227 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:45.886228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:45.886347 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:45.886458 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:45.886501 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 16:47:45.886562 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260811 16:47:45.888451 11933 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:45.887970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56858 (local address 127.2.55.129:36311)
0811 16:47:45.888005 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:45.888007 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:45.888024 (+ 17us) server_negotiation.cc:407] Connection header received
0811 16:47:45.888076 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:45.888077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:45.888085 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:45.888124 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:45.888417 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56858: BlockingRecv error: recv got EOF from 127.0.0.1:56858 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 16:47:45.888518 2270 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/krb5cc' of type FILE
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:45.889533 2270 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:45.890413 2270 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.129@KRBTEST.COM
I20260811 16:47:45.897200 11933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:45.890941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56864 (local address 127.2.55.129:36311)
0811 16:47:45.891003 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:45.891005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:45.891066 (+ 61us) server_negotiation.cc:407] Connection header received
0811 16:47:45.891146 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:45.891147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:45.891159 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:45.891226 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:45.891604 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.892080 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.892757 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.893022 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.893099 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:45.894997 (+ 1898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:45.894999 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:45.894999 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:45.895005 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:45.896189 (+ 1184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:45.896481 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:45.896481 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:45.896482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:45.896532 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:45.896699 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:45.896699 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:45.896699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:45.896784 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:45.896909 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:45.897011 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 16:47:45.897073 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260811 16:47:45.898908 11933 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:45.898162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56870 (local address 127.2.55.129:36311)
0811 16:47:45.898196 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:45.898198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:45.898296 (+ 98us) server_negotiation.cc:407] Connection header received
0811 16:47:45.898353 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:45.898354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:45.898363 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:45.898434 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:45.898843 (+ 409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56870: BlockingRecv error: recv got EOF from 127.0.0.1:56870 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260811 16:47:45.899135 2270 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466835675343-2270-0/krb5kdc/krb5cc' of type FILE
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:45.900035 2270 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:45.900925 2270 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 16:47:45 dist-test-slave-3h5h krb5kdc[11136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.129@KRBTEST.COM
I20260811 16:47:45.907339 11933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:45.901434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56872 (local address 127.2.55.129:36311)
0811 16:47:45.901491 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:45.901493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:45.901519 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:47:45.901568 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:45.901569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:45.901576 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:45.901621 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:45.901938 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.902380 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.903004 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:45.903172 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:45.903225 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:45.905206 (+ 1981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:45.905207 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:45.905207 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:45.905214 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:45.906351 (+ 1137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:45.906693 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:45.906694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:45.906695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:45.906754 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:45.906963 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:45.906963 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:45.906964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:45.907059 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:45.907164 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:45.907220 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 16:47:45.907280 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:47:45.908169 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 11296
I20260811 16:47:45.925649 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 11502
I20260811 16:47:45.947551 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 11707
I20260811 16:47:45.955489 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 11155
2026-08-11T16:47:45Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2212 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:47:46 dist-test-slave-3h5h krb5kdc[11950](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:47:46 dist-test-slave-3h5h krb5kdc[11950](info): set up 2 sockets
Aug 11 16:47:46 dist-test-slave-3h5h krb5kdc[11950](info): commencing operation
krb5kdc: starting...
W20260811 16:47:47.307500 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.324s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:47:47 dist-test-slave-3h5h krb5kdc[11950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:47:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:47Z Disabled control of system clock
WARNING: no policy specified for oryx/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.190.keytab.
Entry for principal oryx/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.190.keytab.
I20260811 16:47:47.437304 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:32981
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.190.keytab
--principal=oryx/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:32981
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:47.524187 11974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:47.524437 11974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:47.524475 11974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:47.525645 11974 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:47.525715 11974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:47.525738 11974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:47.525756 11974 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:47.525786 11974 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:47.527263 11974 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:32981
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.190.keytab
--principal=oryx/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:32981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:47.527532 11974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:47.527758 11974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:47.532704 11985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:47.532734 11982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:47.532734 11983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:47.532773 11974 server_base.cc:1034] running on GCE node
I20260811 16:47:47.533161 11974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:47.533408 11974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:47.534550 11974 hybrid_clock.cc:648] HybridClock initialized: now 1786466867534517 us; error 51 us; skew 500 ppm
Aug 11 16:47:47 dist-test-slave-3h5h krb5kdc[11950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466867, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:47.537115 11974 init.cc:377] Logged in from keytab as oryx/127.2.55.190@KRBTEST.COM (short username oryx)
I20260811 16:47:47.537499 11974 webserver.cc:460] Webserver started at http://127.2.55.190:41493/ using document root <none> and password file <none>
I20260811 16:47:47.537693 11974 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:47.537734 11974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:47.537825 11974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:47.538841 11974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "c15aa67b0c6b4e10bde14c83c174eb6e"
format_stamp: "Formatted at 2026-08-11 16:47:47 on dist-test-slave-3h5h"
server_key: "504addc30a12fc0c778c05b1c0362e35"
server_key_iv: "12272b191d6f816c4fb212d9145d01dc"
server_key_version: "encryptionkey@0"
I20260811 16:47:47.539144 11974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "c15aa67b0c6b4e10bde14c83c174eb6e"
format_stamp: "Formatted at 2026-08-11 16:47:47 on dist-test-slave-3h5h"
server_key: "504addc30a12fc0c778c05b1c0362e35"
server_key_iv: "12272b191d6f816c4fb212d9145d01dc"
server_key_version: "encryptionkey@0"
I20260811 16:47:47.540457 11974 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:47:47.541320 11994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:47.541514 11974 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:47:47.541602 11974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "c15aa67b0c6b4e10bde14c83c174eb6e"
format_stamp: "Formatted at 2026-08-11 16:47:47 on dist-test-slave-3h5h"
server_key: "504addc30a12fc0c778c05b1c0362e35"
server_key_iv: "12272b191d6f816c4fb212d9145d01dc"
server_key_version: "encryptionkey@0"
I20260811 16:47:47.541689 11974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:47.556164 11974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:47.558122 11974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:47.558238 11974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:47.562538 11974 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:32981
I20260811 16:47:47.562618 12079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:32981 every 8 connection(s)
I20260811 16:47:47.563143 11974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:47.564225 12080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:47.566712 12080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e: Bootstrap starting.
I20260811 16:47:47.567337 12080 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:47.567651 12080 log.cc:824] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:47.568408 12080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e: No bootstrap required, opened a new log
I20260811 16:47:47.570099 12080 raft_consensus.cc:348] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } }
I20260811 16:47:47.570272 12080 raft_consensus.cc:374] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:47.570327 12080 raft_consensus.cc:729] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15aa67b0c6b4e10bde14c83c174eb6e, State: Initialized, Role: FOLLOWER
I20260811 16:47:47.570492 12080 consensus_queue.cc:260] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } }
I20260811 16:47:47.570597 12080 raft_consensus.cc:388] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:47.570644 12080 raft_consensus.cc:482] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:47.570699 12080 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:47.571539 12080 raft_consensus.cc:504] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } }
I20260811 16:47:47.571663 12080 leader_election.cc:302] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c15aa67b0c6b4e10bde14c83c174eb6e; no voters:
I20260811 16:47:47.571858 12080 leader_election.cc:288] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:47.571902 12086 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:47.572101 12086 raft_consensus.cc:686] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [term 1 LEADER]: Becoming Leader. State: Replica: c15aa67b0c6b4e10bde14c83c174eb6e, State: Running, Role: LEADER
I20260811 16:47:47.572126 12080 sys_catalog.cc:564] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:47.572217 12086 consensus_queue.cc:237] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } }
I20260811 16:47:47.572593 12088 sys_catalog.cc:455] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c15aa67b0c6b4e10bde14c83c174eb6e. Latest consensus state: current_term: 1 leader_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } }
I20260811 16:47:47.572692 12088 sys_catalog.cc:458] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:47.572584 12087 sys_catalog.cc:455] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } }
I20260811 16:47:47.572875 12087 sys_catalog.cc:458] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:47.573352 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 11974
I20260811 16:47:47.573369 12096 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:47.573475 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:47.573691 2270 external_mini_cluster.cc:1428] Setting key 7a60f7e92038d6265da62f9bea1c041f
I20260811 16:47:47.574024 12096 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:47.575847 12096 catalog_manager.cc:1347] Generated new cluster ID: ed0b8e4c96324510b4b71044242c7681
I20260811 16:47:47.575918 12096 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:47:47 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM
I20260811 16:47:47.586988 12111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:47.574538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54168 (local address 127.2.55.190:32981)
0811 16:47:47.574726 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:47.574735 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:47.574771 (+ 36us) server_negotiation.cc:407] Connection header received
0811 16:47:47.574890 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:47.574897 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:47.574967 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:47.575116 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:47.577095 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:47.578567 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:47.579591 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:47.580238 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:47.580358 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:47.583233 (+ 2875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:47.583238 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:47.583238 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:47.583270 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:47.585325 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:47.585728 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:47.585732 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:47.585732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:47.585839 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:47.586050 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:47.586051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:47.586051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:47.586353 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:47.586510 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:47.586616 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 16:47:47.586752 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":81,"threads_started":1}
I20260811 16:47:47.588636 12096 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:47.589213 12096 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:47.594983 12096 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e: Generated new TSK 0
I20260811 16:47:47.595165 12096 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.129.keytab.
Entry for principal oryx/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.129.keytab.
I20260811 16:47:47.624603 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:32981
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.129.keytab
--principal=oryx/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:47.710273 12115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:47.710469 12115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:47.710493 12115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:47.711556 12115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:47.711592 12115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:47.711617 12115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:47:47.713023 12115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.129.keytab
--principal=oryx/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:32981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:47.713204 12115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:47.713375 12115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:47.718452 12121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:47.718493 12115 server_base.cc:1034] running on GCE node
W20260811 16:47:47.718461 12123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:47.718472 12120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:47.718834 12115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:47.719027 12115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:47.720171 12115 hybrid_clock.cc:648] HybridClock initialized: now 1786466867720139 us; error 53 us; skew 500 ppm
Aug 11 16:47:47 dist-test-slave-3h5h krb5kdc[11950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466867, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:47.722787 12115 init.cc:377] Logged in from keytab as oryx/127.2.55.129@KRBTEST.COM (short username oryx)
I20260811 16:47:47.723260 12115 webserver.cc:460] Webserver started at http://127.2.55.129:39611/ using document root <none> and password file <none>
I20260811 16:47:47.723517 12115 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:47.723563 12115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:47.723742 12115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:47.724776 12115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "d0d2941eac2a4299b74d9b1469d64c4a"
format_stamp: "Formatted at 2026-08-11 16:47:47 on dist-test-slave-3h5h"
server_key: "08405d7b46c722196f2c46b6be3aa50e"
server_key_iv: "4ba8a3b8ae848c4c41a4b0b72ec136e9"
server_key_version: "encryptionkey@0"
I20260811 16:47:47.725222 12115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "d0d2941eac2a4299b74d9b1469d64c4a"
format_stamp: "Formatted at 2026-08-11 16:47:47 on dist-test-slave-3h5h"
server_key: "08405d7b46c722196f2c46b6be3aa50e"
server_key_iv: "4ba8a3b8ae848c4c41a4b0b72ec136e9"
server_key_version: "encryptionkey@0"
I20260811 16:47:47.726562 12115 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:47.727348 12135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:47.727525 12115 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:47.727619 12115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "d0d2941eac2a4299b74d9b1469d64c4a"
format_stamp: "Formatted at 2026-08-11 16:47:47 on dist-test-slave-3h5h"
server_key: "08405d7b46c722196f2c46b6be3aa50e"
server_key_iv: "4ba8a3b8ae848c4c41a4b0b72ec136e9"
server_key_version: "encryptionkey@0"
I20260811 16:47:47.727722 12115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:47.754123 12115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:47.756436 12115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:47.756619 12115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:47.756920 12115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:47.757266 12115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:47.757325 12115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:47.757371 12115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:47.757396 12115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:47.763643 12115 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:37995
I20260811 16:47:47.763693 12310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:37995 every 8 connection(s)
I20260811 16:47:47.764029 12115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:47:47.770475 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 12115
Aug 11 16:47:47 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466867, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM
I20260811 16:47:47.770610 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:47:47.770829 2270 external_mini_cluster.cc:1428] Setting key 226a77516ced083345066c9c94108f24
I20260811 16:47:47.774964 12111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:47.764906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:54393 (local address 127.2.55.190:32981)
0811 16:47:47.764996 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:47.764998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:47.765208 (+ 210us) server_negotiation.cc:407] Connection header received
0811 16:47:47.765758 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:47.765759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:47.765778 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:47.765837 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:47.766822 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:47.767348 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:47.768356 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:47.768586 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:47.768677 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:47.771193 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:47.771195 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:47.771196 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:47.771204 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:47.773117 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:47.773643 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:47.773644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:47.773645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:47.773740 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:47.774146 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:47.774147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:47.774147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:47.774301 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:47.774399 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:47.774749 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 16:47:47.774856 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 16:47:47.775250 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:47.764832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.129:54393)
0811 16:47:47.765054 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:47.765095 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:47.765614 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:47.765916 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:47.765920 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:47.766501 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:47.766708 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:47.766713 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:47.767454 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:47.767455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:47.768254 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:47.768257 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:47.768696 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:47.768698 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:47.768822 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:47.769337 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:47.769345 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:47.771105 (+ 1760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:47.773228 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:47.773237 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:47.773240 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:47.773535 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:47.773847 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:47.773848 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:47.773849 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:47.774053 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:47.774389 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:47.774397 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:47.774562 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 16:47:47.774717 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 16:47:47.774910 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":101,"threads_started":1}
I20260811 16:47:47.775900 12311 heartbeater.cc:347] Connected to a master server at 127.2.55.190:32981
I20260811 16:47:47.776039 12311 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:47.776276 12311 heartbeater.cc:511] Master 127.2.55.190:32981 requested a full tablet report, sending...
I20260811 16:47:47.776990 12025 ts_manager.cc:194] Registered new tserver with Master: d0d2941eac2a4299b74d9b1469d64c4a (127.2.55.129:37995)
I20260811 16:47:47.778007 12025 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:54393
WARNING: no policy specified for oryx/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.130.keytab.
Entry for principal oryx/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.130.keytab.
I20260811 16:47:47.800815 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:32981
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.130.keytab
--principal=oryx/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:47.888623 12318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:47.888892 12318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:47.888935 12318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:47.890136 12318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:47.890183 12318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:47.890210 12318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:47:47.891716 12318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.130.keytab
--principal=oryx/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:32981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:47.891923 12318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:47.892113 12318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:47.898023 12331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:47.898007 12328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:47.898007 12329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:47.898231 12318 server_base.cc:1034] running on GCE node
I20260811 16:47:47.898612 12318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:47.898857 12318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:47.900014 12318 hybrid_clock.cc:648] HybridClock initialized: now 1786466867899975 us; error 48 us; skew 500 ppm
Aug 11 16:47:47 dist-test-slave-3h5h krb5kdc[11950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466867, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:47.902814 12318 init.cc:377] Logged in from keytab as oryx/127.2.55.130@KRBTEST.COM (short username oryx)
I20260811 16:47:47.903218 12318 webserver.cc:460] Webserver started at http://127.2.55.130:40323/ using document root <none> and password file <none>
I20260811 16:47:47.903422 12318 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:47.903465 12318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:47.903584 12318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:47.904613 12318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "98acc595193142a68059dd161eb1a567"
format_stamp: "Formatted at 2026-08-11 16:47:47 on dist-test-slave-3h5h"
server_key: "0c49d0ab4b26b3da7a4dd27e42e0457e"
server_key_iv: "74c00c64dfcfe2c36c5620298ea35968"
server_key_version: "encryptionkey@0"
I20260811 16:47:47.904984 12318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "98acc595193142a68059dd161eb1a567"
format_stamp: "Formatted at 2026-08-11 16:47:47 on dist-test-slave-3h5h"
server_key: "0c49d0ab4b26b3da7a4dd27e42e0457e"
server_key_iv: "74c00c64dfcfe2c36c5620298ea35968"
server_key_version: "encryptionkey@0"
I20260811 16:47:47.906252 12318 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:47.907015 12339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:47.907200 12318 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:47:47.907310 12318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "98acc595193142a68059dd161eb1a567"
format_stamp: "Formatted at 2026-08-11 16:47:47 on dist-test-slave-3h5h"
server_key: "0c49d0ab4b26b3da7a4dd27e42e0457e"
server_key_iv: "74c00c64dfcfe2c36c5620298ea35968"
server_key_version: "encryptionkey@0"
I20260811 16:47:47.907383 12318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:47.930346 12318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:47.932534 12318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:47.932710 12318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:47.932976 12318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:47.933321 12318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:47.933378 12318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:47.933423 12318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:47.933452 12318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:47.939268 12318 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:46151
I20260811 16:47:47.939348 12517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:46151 every 8 connection(s)
I20260811 16:47:47.939684 12318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:47:47 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466867, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM
I20260811 16:47:47.947175 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 12318
I20260811 16:47:47.947325 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:47:47.947568 2270 external_mini_cluster.cc:1428] Setting key 2663fa81610c99f05067f85468ca6f54
I20260811 16:47:47.949911 12111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:47.940455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:34889 (local address 127.2.55.190:32981)
0811 16:47:47.940543 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:47.940546 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:47.940725 (+ 179us) server_negotiation.cc:407] Connection header received
0811 16:47:47.941290 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:47.941291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:47.941303 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:47.941358 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:47.942299 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:47.942797 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:47.943841 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:47.944091 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:47.944179 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:47.946489 (+ 2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:47.946490 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:47.946491 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:47.946499 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:47.948176 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:47.948702 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:47.948703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:47.948704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:47.948770 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:47.949138 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:47.949139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:47.949139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:47.949315 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:47.949390 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:47.949663 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 16:47:47.949768 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 16:47:47.950047 12520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:47.940412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.130:34889)
0811 16:47:47.940597 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:47.940634 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:47.941190 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:47.941413 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:47.941417 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:47.942012 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:47.942214 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:47.942219 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:47.942879 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:47.942880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:47.943706 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:47.943709 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:47.944188 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:47.944190 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:47.944292 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:47.944801 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:47.944809 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:47.946397 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:47.948272 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:47.948299 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:47.948301 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:47.948618 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:47.948920 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:47.948921 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:47.948921 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:47.949059 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:47.949385 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:47.949390 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:47.949505 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 16:47:47.949584 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 16:47:47.949768 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":106,"threads_started":1}
I20260811 16:47:47.950681 12518 heartbeater.cc:347] Connected to a master server at 127.2.55.190:32981
I20260811 16:47:47.950790 12518 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:47.950980 12518 heartbeater.cc:511] Master 127.2.55.190:32981 requested a full tablet report, sending...
I20260811 16:47:47.951390 12025 ts_manager.cc:194] Registered new tserver with Master: 98acc595193142a68059dd161eb1a567 (127.2.55.130:46151)
I20260811 16:47:47.951874 12025 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:34889
WARNING: no policy specified for oryx/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.131.keytab.
Entry for principal oryx/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.131.keytab.
I20260811 16:47:47.980589 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:32981
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.131.keytab
--principal=oryx/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:48.066075 12525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:48.066332 12525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:48.066376 12525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:48.067572 12525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:48.067647 12525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:48.067698 12525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:47:48.069303 12525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.131.keytab
--principal=oryx/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:32981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:48.069592 12525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:48.069836 12525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:48.075537 12535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:48.075536 12540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:48.075544 12536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:48.076094 12525 server_base.cc:1034] running on GCE node
I20260811 16:47:48.076363 12525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:48.076655 12525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:48.077821 12525 hybrid_clock.cc:648] HybridClock initialized: now 1786466868077803 us; error 36 us; skew 500 ppm
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:48.080413 12525 init.cc:377] Logged in from keytab as oryx/127.2.55.131@KRBTEST.COM (short username oryx)
I20260811 16:47:48.080991 12525 webserver.cc:460] Webserver started at http://127.2.55.131:38121/ using document root <none> and password file <none>
I20260811 16:47:48.081250 12525 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:48.081321 12525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:48.081463 12525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:48.082525 12525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "fc3d668aa13846cab5c2bd23cb8a49c8"
format_stamp: "Formatted at 2026-08-11 16:47:48 on dist-test-slave-3h5h"
server_key: "500a5cdb0583ad9642de9355469e56bb"
server_key_iv: "c9b8fee4db02fd4e909ff858b1cb4b00"
server_key_version: "encryptionkey@0"
I20260811 16:47:48.082927 12525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "fc3d668aa13846cab5c2bd23cb8a49c8"
format_stamp: "Formatted at 2026-08-11 16:47:48 on dist-test-slave-3h5h"
server_key: "500a5cdb0583ad9642de9355469e56bb"
server_key_iv: "c9b8fee4db02fd4e909ff858b1cb4b00"
server_key_version: "encryptionkey@0"
I20260811 16:47:48.084275 12525 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:48.085053 12550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.085228 12525 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:48.085340 12525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "fc3d668aa13846cab5c2bd23cb8a49c8"
format_stamp: "Formatted at 2026-08-11 16:47:48 on dist-test-slave-3h5h"
server_key: "500a5cdb0583ad9642de9355469e56bb"
server_key_iv: "c9b8fee4db02fd4e909ff858b1cb4b00"
server_key_version: "encryptionkey@0"
I20260811 16:47:48.085415 12525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:48.094465 12525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:48.096923 12525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:48.097075 12525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:48.097311 12525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:48.097633 12525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:48.097684 12525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.097733 12525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:48.097759 12525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.103492 12525 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:41437
I20260811 16:47:48.103585 12725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:41437 every 8 connection(s)
I20260811 16:47:48.103902 12525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:47:48.106459 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 12525
I20260811 16:47:48.106561 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:47:48.106746 2270 external_mini_cluster.cc:1428] Setting key 7a2076f12fa987bc68f4b97f6cb47c91
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM
I20260811 16:47:48.113554 12111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.104723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:36187 (local address 127.2.55.190:32981)
0811 16:47:48.104785 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.104787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.105001 (+ 214us) server_negotiation.cc:407] Connection header received
0811 16:47:48.105465 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.105467 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.105480 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.105549 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.106465 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.107330 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.108552 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.108768 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.108906 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.111025 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.111026 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.111026 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.111033 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.112285 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.112652 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.112653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.112653 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.112704 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.112991 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.112991 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.112992 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.113100 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.113151 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.113422 (+ 271us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.113490 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 16:47:48.113824 12728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.104673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.131:36187)
0811 16:47:48.104869 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.104911 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.105381 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.105602 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.105605 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.106171 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.106364 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.106369 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.107446 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.107448 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.108390 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.108394 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.108891 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.108892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.108999 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.109521 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.109530 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.110937 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.112360 (+ 1423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.112366 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.112368 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.112587 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.112763 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.112764 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.112764 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.112935 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.113155 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.113160 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.113283 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.113362 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.113555 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":94,"threads_started":1}
I20260811 16:47:48.114403 12726 heartbeater.cc:347] Connected to a master server at 127.2.55.190:32981
I20260811 16:47:48.114519 12726 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:48.114724 12726 heartbeater.cc:511] Master 127.2.55.190:32981 requested a full tablet report, sending...
I20260811 16:47:48.115135 12025 ts_manager.cc:194] Registered new tserver with Master: fc3d668aa13846cab5c2bd23cb8a49c8 (127.2.55.131:41437)
I20260811 16:47:48.115505 12025 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:36187
I20260811 16:47:48.118556 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.2.55.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.55.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.55.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.189.keytab.
Entry for principal oryx/127.2.55.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.189.keytab.
I20260811 16:47:48.149729 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.189:45195
--webserver_interface=127.2.55.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.189.keytab
--principal=oryx/127.2.55.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:32981,127.2.55.189:45195
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:48.234025 12731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:48.234280 12731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:48.234323 12731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:48.235468 12731 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:48.235536 12731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:48.235561 12731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:48.235587 12731 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:48.235618 12731 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:48.237138 12731 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:32981,127.2.55.189:45195
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.189.keytab
--principal=oryx/127.2.55.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.189:45195
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.55.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
W20260811 16:47:48.237309 12731 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.2.55.190:32981,127.2.55.189:45195'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 16:47:48.237468 12731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:48.237699 12731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:48.242673 12747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:48.242637 12744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:48.242859 12740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:48.242869 12731 server_base.cc:1034] running on GCE node
I20260811 16:47:48.243151 12731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:48.243414 12731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:48.244589 12731 hybrid_clock.cc:648] HybridClock initialized: now 1786466868244579 us; error 31 us; skew 500 ppm
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:48.247294 12731 init.cc:377] Logged in from keytab as oryx/127.2.55.189@KRBTEST.COM (short username oryx)
I20260811 16:47:48.247709 12731 webserver.cc:460] Webserver started at http://127.2.55.189:44311/ using document root <none> and password file <none>
I20260811 16:47:48.247908 12731 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:48.247951 12731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:48.248042 12731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:48.249202 12731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/data/instance:
uuid: "cb276d7b826c4576b9fb093714f25a04"
format_stamp: "Formatted at 2026-08-11 16:47:48 on dist-test-slave-3h5h"
server_key: "d9f0a7f446e2e268ceaa4eecc36ec918"
server_key_iv: "5af19df9efc84f29f379338da4619d24"
server_key_version: "encryptionkey@0"
I20260811 16:47:48.249600 12731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/wal/instance:
uuid: "cb276d7b826c4576b9fb093714f25a04"
format_stamp: "Formatted at 2026-08-11 16:47:48 on dist-test-slave-3h5h"
server_key: "d9f0a7f446e2e268ceaa4eecc36ec918"
server_key_iv: "5af19df9efc84f29f379338da4619d24"
server_key_version: "encryptionkey@0"
I20260811 16:47:48.251293 12731 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:47:48.252066 12755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.252271 12731 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:48.252362 12731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/wal
uuid: "cb276d7b826c4576b9fb093714f25a04"
format_stamp: "Formatted at 2026-08-11 16:47:48 on dist-test-slave-3h5h"
server_key: "d9f0a7f446e2e268ceaa4eecc36ec918"
server_key_iv: "5af19df9efc84f29f379338da4619d24"
server_key_version: "encryptionkey@0"
I20260811 16:47:48.252420 12731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:48.267591 12731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:48.269943 12731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:48.270066 12731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:48.274386 12731 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.189:45195
I20260811 16:47:48.274474 12834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.189:45195 every 8 connection(s)
I20260811 16:47:48.274830 12731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/data/info.pb
I20260811 16:47:48.275903 12837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:48.275892 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 12731
I20260811 16:47:48.278378 12837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.2.55.189@KRBTEST.COM
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.189@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM
I20260811 16:47:48.287249 12841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.276695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34028 (local address 127.2.55.189:45195)
0811 16:47:48.276885 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.276895 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.276930 (+ 35us) server_negotiation.cc:407] Connection header received
0811 16:47:48.277381 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.277387 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.277435 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.277547 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.278368 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.279628 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.280600 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.281197 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.281307 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.283880 (+ 2573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.283889 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.283890 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.283898 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.285503 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.285906 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.285909 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.285909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.285985 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.286208 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.286209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.286209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.286532 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.286679 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.286812 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.286982 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":81,"threads_started":1}
I20260811 16:47:48.287492 12842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.279010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.0.0.1:54178)
0811 16:47:48.279203 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.279244 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.279324 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.279482 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.279485 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.279831 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.279900 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.279901 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.280786 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.280787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.281611 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.281614 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.281991 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.281991 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.282073 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.282568 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.282576 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.284309 (+ 1733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.286278 (+ 1969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.286282 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.286284 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.286499 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.286759 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.286759 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.286760 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.286826 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.287150 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.287155 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.287204 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.287293 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.287404 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":114,"threads_started":1}
I20260811 16:47:48.287524 12111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.279072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54178 (local address 127.2.55.190:32981)
0811 16:47:48.279154 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.279156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.279312 (+ 156us) server_negotiation.cc:407] Connection header received
0811 16:47:48.279385 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.279386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.279396 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.279447 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.279983 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.280701 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.281702 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.281892 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.281967 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.284398 (+ 2431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.284399 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.284399 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.284406 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.286207 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.286601 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.286602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.286602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.286668 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.286904 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.286905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.286905 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.287078 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.287136 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.287348 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.287441 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 16:47:48.288218 12837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.189@KRBTEST.COM for oryx/127.2.55.189@KRBTEST.COM
I20260811 16:47:48.294305 12842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.288495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:45195 (local address 127.0.0.1:34032)
0811 16:47:48.288558 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.288569 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.288613 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.288727 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.288728 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.288913 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.288963 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.288965 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.289589 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.289590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.290069 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.290071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.290403 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.290404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.290454 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.290777 (+ 323us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.290781 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.291886 (+ 1105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.293406 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.293406 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.293407 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.293558 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.293753 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.293754 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.293754 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.293804 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.294007 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.294007 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.294057 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.294114 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.294204 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 16:47:48.294317 12841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.288528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34032 (local address 127.2.55.189:45195)
0811 16:47:48.288561 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.288563 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.288599 (+ 36us) server_negotiation.cc:407] Connection header received
0811 16:47:48.288661 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.288662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.288670 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.288723 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.289038 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.289490 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.290151 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.290337 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.290390 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.291960 (+ 1570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.291961 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.291961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.291967 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.293337 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.293637 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.293637 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.293638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.293685 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.293844 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.293844 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.293844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.293941 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.293986 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.294130 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.294249 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":14}
I20260811 16:47:48.295828 12837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: Bootstrap starting.
I20260811 16:47:48.296728 12837 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:48.297061 12837 log.cc:824] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:48.297839 12837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: No bootstrap required, opened a new log
I20260811 16:47:48.299266 12837 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } }
I20260811 16:47:48.299388 12837 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:48.299409 12837 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb276d7b826c4576b9fb093714f25a04, State: Initialized, Role: FOLLOWER
I20260811 16:47:48.299496 12837 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } }
I20260811 16:47:48.299755 12844 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } } }
I20260811 16:47:48.299826 12837 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:48.299844 12844 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 16:47:48.301584 12857 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:47:48.301646 12857 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:47:48.303610 12731 master_runner.cc:428] Detected that this master cb276d7b826c4576b9fb093714f25a04 is joining an existing cluster
I20260811 16:47:48.303668 12731 master_runner.cc:432] Initiating AddMaster RPC to add 127.2.55.189:45195
I20260811 16:47:48.311475 12841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.304953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34048 (local address 127.2.55.189:45195)
0811 16:47:48.304985 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.304987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.305322 (+ 335us) server_negotiation.cc:407] Connection header received
0811 16:47:48.305408 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.305409 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.305417 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.305445 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.305801 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.306245 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.306977 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.307171 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.307254 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.308513 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.308515 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.308516 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.308522 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.310290 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.310646 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.310647 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.310648 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.310703 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.310951 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.310952 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.310952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.311084 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.311126 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.311331 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.311407 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:47:48.311794 12870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.305103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:45195 (local address 127.0.0.1:34048)
0811 16:47:48.305257 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.305267 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.305342 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.305505 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.305505 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.305671 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.305717 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.305718 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.306328 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.306329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.306876 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.306878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.307256 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.307257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.307321 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.307897 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.307901 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.308421 (+ 520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.310385 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.310386 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.310387 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.310557 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.310787 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.310787 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.310787 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.310879 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.311166 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.311167 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.311228 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.311612 (+ 384us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.311703 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":92,"threads_started":1}
I20260811 16:47:48.312153 12111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.304651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54180 (local address 127.2.55.190:32981)
0811 16:47:48.304929 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.304932 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.304943 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:47:48.304971 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.304973 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.304986 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.305052 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.305484 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.306269 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.307343 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.307601 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.307681 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.308634 (+ 953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.308635 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.308636 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.308644 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.310675 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.311084 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.311086 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.311086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.311152 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.311369 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.311370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.311370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.311502 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.311571 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.311978 (+ 407us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.312058 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246}
I20260811 16:47:48.312556 12869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.304605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.0.0.1:54180)
0811 16:47:48.304768 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.304779 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.304829 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.305054 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.305055 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.305301 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.305396 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.305398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.306371 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.306372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.307261 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.307264 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.307681 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.307682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.307762 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.308132 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.308138 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.308542 (+ 404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.310758 (+ 2216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.310759 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.310759 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.311015 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.311234 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.311235 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.311235 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.311301 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.311604 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.311605 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.311649 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.311716 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.311820 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":104,"threads_started":1}
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466867, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.190@KRBTEST.COM for oryx/127.2.55.189@KRBTEST.COM
I20260811 16:47:48.321645 12841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.314945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34050 (local address 127.2.55.189:45195)
0811 16:47:48.314986 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.314988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.315154 (+ 166us) server_negotiation.cc:407] Connection header received
0811 16:47:48.315252 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.315253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.315262 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.315307 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.315713 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.316153 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.316942 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.317145 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.317220 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.319126 (+ 1906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.319127 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.319127 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.319135 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.320431 (+ 1296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.320826 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.320827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.320828 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.320907 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.321115 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.321116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.321117 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.321223 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.321296 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.321485 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.321560 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:47:48.321667 12871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.314892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:45195 (local address 127.0.0.1:34050)
0811 16:47:48.315042 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.315081 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.315178 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.315310 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.315314 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.315577 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.315630 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.315632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.316234 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.316235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.316872 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.316875 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.317222 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.317223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.317302 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.317755 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.317762 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.319035 (+ 1273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.320518 (+ 1483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.320525 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.320527 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.320733 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.320976 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.320977 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.320977 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.321042 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.321290 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.321298 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.321349 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.321444 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.321563 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":71,"threads_started":1}
I20260811 16:47:48.322232 12025 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.2.55.189:45195: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "cb276d7b826c4576b9fb093714f25a04"
member_type: NON_VOTER
last_known_addr {
host: "127.2.55.189"
port: 45195
}
attrs {
promote: true
}
}
dest_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e"
cas_config_opid_index: -1
I20260811 16:47:48.322624 12025 consensus_queue.cc:237] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: NON_VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: true } }
I20260811 16:47:48.323146 12873 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER cb276d7b826c4576b9fb093714f25a04 (127.2.55.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: NON_VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: true } } }
I20260811 16:47:48.323429 12798 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:48.324195 12798 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 1 FOLLOWER]: Refusing update from remote peer c15aa67b0c6b4e10bde14c83c174eb6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 16:47:48.324224 12873 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.2.55.189:45195
I20260811 16:47:48.324303 12873 sys_catalog.cc:455] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: NON_VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: true } } }
I20260811 16:47:48.324361 12873 sys_catalog.cc:458] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:48.324568 12731 master.cc:537] Master@127.2.55.189:45195 shutting down...
I20260811 16:47:48.324551 12872 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: NON_VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 16:47:48.325486 12003 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 16:47:48.325929 12003 consensus_peers.cc:487] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e -> Peer cb276d7b826c4576b9fb093714f25a04 (127.2.55.189:45195): Couldn't send request to peer cb276d7b826c4576b9fb093714f25a04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:47:48.327337 12731 raft_consensus.cc:2229] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:48.327443 12731 raft_consensus.cc:2258] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:48.327502 12731 tablet_replica.cc:330] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: stopping tablet replica
I20260811 16:47:48.340591 12731 master.cc:552] Master@127.2.55.189:45195 shutdown complete.
I20260811 16:47:48.340653 12731 master_runner.cc:305] Clearing existing system tablet
I20260811 16:47:48.340795 12731 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:48.340880 12731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:48.341648 12731 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:48.342211 12879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.342375 12731 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:48.342439 12731 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:47:48.342465 12731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/wal
uuid: "cb276d7b826c4576b9fb093714f25a04"
format_stamp: "Formatted at 2026-08-11 16:47:48 on dist-test-slave-3h5h"
server_key: "d9f0a7f446e2e268ceaa4eecc36ec918"
server_key_iv: "5af19df9efc84f29f379338da4619d24"
server_key_version: "encryptionkey@0"
I20260811 16:47:48.343418 12731 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:48.345263 12731 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 16:47:48.345340 12731 log.cc:1196] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 16:47:48.345542 12731 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: Deleting consensus metadata
I20260811 16:47:48.345669 12731 master_runner.cc:315] Copying system tablet from 127.2.55.190:32981
I20260811 16:47:48.346307 12731 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: tablet copy: Beginning tablet copy session from remote peer at address 127.2.55.190:32981
I20260811 16:47:48.353159 12111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.346776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54188 (local address 127.2.55.190:32981)
0811 16:47:48.346826 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.346828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.346895 (+ 67us) server_negotiation.cc:407] Connection header received
0811 16:47:48.346964 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.346964 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.346974 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.347020 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.347412 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.347921 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.349099 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.349290 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.349348 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.350467 (+ 1119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.350469 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.350470 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.350480 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.351961 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.352389 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.352390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.352390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.352449 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.352657 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.352658 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.352658 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.352763 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.352816 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.353018 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.353084 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:47:48.353225 12888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.346670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.0.0.1:54188)
0811 16:47:48.346810 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.346823 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.346898 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.347036 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.347037 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.347267 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.347331 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.347333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.348014 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.348015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.349008 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.349012 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.349380 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.349381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.349455 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.349912 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.349918 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.350349 (+ 431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.352046 (+ 1697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.352048 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.352048 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.352306 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.352521 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.352522 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.352522 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.352592 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.352829 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.352861 (+ 32us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.352911 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.352987 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.353097 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":92,"threads_started":1}
I20260811 16:47:48.353868 12056 tablet_copy_service.cc:140] P c15aa67b0c6b4e10bde14c83c174eb6e: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer cb276d7b826c4576b9fb093714f25a04 ({username='oryx', principal='oryx/127.2.55.189@KRBTEST.COM'} at 127.0.0.1:54188)
I20260811 16:47:48.354014 12056 tablet_copy_service.cc:161] P c15aa67b0c6b4e10bde14c83c174eb6e: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer cb276d7b826c4576b9fb093714f25a04 at {username='oryx', principal='oryx/127.2.55.189@KRBTEST.COM'} at 127.0.0.1:54188: session id = cb276d7b826c4576b9fb093714f25a04-00000000000000000000000000000000
I20260811 16:47:48.354818 12056 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:47:48.355526 12731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 16:47:48.356976 12731 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: tablet copy: Starting download of 0 data blocks...
I20260811 16:47:48.357159 12731 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: tablet copy: Starting download of 1 WAL segments...
I20260811 16:47:48.358173 12731 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:47:48.359107 12056 tablet_copy_service.cc:342] P c15aa67b0c6b4e10bde14c83c174eb6e: Request end of tablet copy session cb276d7b826c4576b9fb093714f25a04-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.2.55.189@KRBTEST.COM'} at 127.0.0.1:54188
I20260811 16:47:48.359171 12056 tablet_copy_service.cc:433] P c15aa67b0c6b4e10bde14c83c174eb6e: ending tablet copy session cb276d7b826c4576b9fb093714f25a04-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer cb276d7b826c4576b9fb093714f25a04
I20260811 16:47:48.362028 12731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:48.363340 12889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:48.363406 12891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:48.363664 12893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:48.363940 12731 server_base.cc:1034] running on GCE node
I20260811 16:47:48.364037 12731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:48.364171 12731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:48.365307 12731 hybrid_clock.cc:648] HybridClock initialized: now 1786466868365304 us; error 31 us; skew 500 ppm
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:48.366626 12731 init.cc:377] Logged in from keytab as oryx/127.2.55.189@KRBTEST.COM (short username oryx)
I20260811 16:47:48.366912 12731 webserver.cc:460] Webserver started at http://127.2.55.189:42335/ using document root <none> and password file <none>
I20260811 16:47:48.367027 12731 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:48.367054 12731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:48.367710 12731 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.368273 12903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.368391 12731 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.368435 12731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/wal
uuid: "cb276d7b826c4576b9fb093714f25a04"
format_stamp: "Formatted at 2026-08-11 16:47:48 on dist-test-slave-3h5h"
server_key: "d9f0a7f446e2e268ceaa4eecc36ec918"
server_key_iv: "5af19df9efc84f29f379338da4619d24"
server_key_version: "encryptionkey@0"
I20260811 16:47:48.368489 12731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:48.378800 12731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:48.380336 12731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:48.383546 12731 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.189:45195
I20260811 16:47:48.383803 12988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.189:45195 every 8 connection(s)
I20260811 16:47:48.383957 12731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-1/data/info.pb
I20260811 16:47:48.384984 12990 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:47:48.385574 12990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: Bootstrap starting.
I20260811 16:47:48.388988 12990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:47:48.389253 12990 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: Bootstrap complete.
I20260811 16:47:48.389460 12990 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: NON_VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: true } }
I20260811 16:47:48.389540 12990 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cb276d7b826c4576b9fb093714f25a04, State: Initialized, Role: LEARNER
I20260811 16:47:48.389580 12990 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: NON_VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: true } }
I20260811 16:47:48.389758 12990 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:48.389776 12994 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: NON_VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: true } } }
I20260811 16:47:48.389873 12994 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: This master's current role is: LEARNER
I20260811 16:47:48.391280 13010 catalog_manager.cc:1259] Loaded cluster ID: ed0b8e4c96324510b4b71044242c7681
I20260811 16:47:48.391436 13010 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: loading cluster ID for follower catalog manager: success
I20260811 16:47:48.393175 13010 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: acquiring CA information for follower catalog manager: success
I20260811 16:47:48.393503 13010 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:47:48.396312 12993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.389027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34078 (local address 127.2.55.189:45195)
0811 16:47:48.389161 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.389164 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.389173 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:48.389196 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.389197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.389208 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.389269 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.389930 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.390838 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.391752 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.392016 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.392096 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.393559 (+ 1463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.393561 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.393561 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.393569 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.395173 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.395514 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.395515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.395516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.395586 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.395780 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.395781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.395782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.395923 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.396027 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.396108 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.396220 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":87,"threads_started":1}
WARNING: no policy specified for oryx/127.2.55.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.55.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.55.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.188.keytab.
Entry for principal oryx/127.2.55.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.188.keytab.
I20260811 16:47:48.424167 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.188:44659
--webserver_interface=127.2.55.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.188.keytab
--principal=oryx/127.2.55.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:32981,127.2.55.189:45195,127.2.55.188:44659
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:48.512378 13016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:48.512717 13016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:48.512758 13016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:48.514279 13016 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:48.514356 13016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:48.514386 13016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:48.514418 13016 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:48.514446 13016 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:48.516045 13016 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:32981,127.2.55.189:45195,127.2.55.188:44659
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.188.keytab
--principal=oryx/127.2.55.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.188:44659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.55.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:48.516327 13016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:48.516571 13016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:48.521514 13023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:48.521554 13028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:48.521602 13016 server_base.cc:1034] running on GCE node
W20260811 16:47:48.521806 13026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:48.522058 13016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:48.522330 13016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:48.523471 13016 hybrid_clock.cc:648] HybridClock initialized: now 1786466868523459 us; error 30 us; skew 500 ppm
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:48.526194 13016 init.cc:377] Logged in from keytab as oryx/127.2.55.188@KRBTEST.COM (short username oryx)
I20260811 16:47:48.526646 13016 webserver.cc:460] Webserver started at http://127.2.55.188:39173/ using document root <none> and password file <none>
I20260811 16:47:48.526891 13016 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:48.526937 13016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:48.527110 13016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:48.528204 13016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/data/instance:
uuid: "7a2869c141d846539ffe3865d983537f"
format_stamp: "Formatted at 2026-08-11 16:47:48 on dist-test-slave-3h5h"
server_key: "a099092ab3a6fb4f394f198e09bb9adc"
server_key_iv: "e2c997d348df301e9729b47209d7acf2"
server_key_version: "encryptionkey@0"
I20260811 16:47:48.528576 13016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/wal/instance:
uuid: "7a2869c141d846539ffe3865d983537f"
format_stamp: "Formatted at 2026-08-11 16:47:48 on dist-test-slave-3h5h"
server_key: "a099092ab3a6fb4f394f198e09bb9adc"
server_key_iv: "e2c997d348df301e9729b47209d7acf2"
server_key_version: "encryptionkey@0"
I20260811 16:47:48.530320 13016 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:47:48.531087 13040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.531272 13016 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:48.531392 13016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/wal
uuid: "7a2869c141d846539ffe3865d983537f"
format_stamp: "Formatted at 2026-08-11 16:47:48 on dist-test-slave-3h5h"
server_key: "a099092ab3a6fb4f394f198e09bb9adc"
server_key_iv: "e2c997d348df301e9729b47209d7acf2"
server_key_version: "encryptionkey@0"
I20260811 16:47:48.531446 13016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:48.555465 13016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:48.557405 13016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:48.557518 13016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:48.562650 13016 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.188:44659
I20260811 16:47:48.562671 13110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.188:44659 every 8 connection(s)
I20260811 16:47:48.563050 13016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/data/info.pb
I20260811 16:47:48.564200 13111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:48.566370 13111 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:47:48.569936 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 13016
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.188@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.2.55.188@KRBTEST.COM
I20260811 16:47:48.576252 12111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.567190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54198 (local address 127.2.55.190:32981)
0811 16:47:48.567286 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.567289 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.567446 (+ 157us) server_negotiation.cc:407] Connection header received
0811 16:47:48.567888 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.567889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.567899 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.567961 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.568703 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.569278 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.570431 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.570740 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.570792 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.573257 (+ 2465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.573258 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.573259 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.573266 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.574768 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.575236 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.575237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.575237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.575301 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.575560 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.575561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.575561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.575690 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.575767 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.576077 (+ 310us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.576159 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 16:47:48.576471 13117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.567053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.0.0.1:54198)
0811 16:47:48.567297 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.567339 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.567803 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.568025 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.568028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.568352 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.568619 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.568624 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.569369 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.569371 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.570331 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.570334 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.570799 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.570800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.570962 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.571525 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.571533 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.573136 (+ 1603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.574872 (+ 1736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.574880 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.574882 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.575133 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.575377 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.575378 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.575379 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.575492 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.575769 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.575777 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.575939 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.576050 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.576218 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":171,"threads_started":1}
I20260811 16:47:48.577342 13111 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:47:48.579339 13118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.570567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60566 (local address 127.2.55.188:44659)
0811 16:47:48.570762 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.570767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.570786 (+ 19us) server_negotiation.cc:407] Connection header received
0811 16:47:48.570805 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.570807 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.570826 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.570911 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.571510 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.572270 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.573246 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.573818 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.573886 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.576284 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.576292 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.576292 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.576306 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.578111 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.578482 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.578486 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.578486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.578546 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.578760 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.578761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.578762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.578909 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.579079 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.579149 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.579226 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":165,"thread_start_us":133,"threads_started":1}
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.188@KRBTEST.COM for oryx/127.2.55.189@KRBTEST.COM
I20260811 16:47:48.583802 13117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.577646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:45195 (local address 127.0.0.1:34086)
0811 16:47:48.577700 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.577712 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.577752 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.577897 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.577898 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.578104 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.578148 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.578149 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.578802 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.578804 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.579328 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.579331 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.579916 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.579917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.579992 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.580303 (+ 311us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.580307 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.581510 (+ 1203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.582849 (+ 1339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.582849 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.582850 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.583029 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.583257 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.583259 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.583259 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.583326 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.583555 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.583556 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.583595 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.583657 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.583736 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":2}
I20260811 16:47:48.583807 12993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.577741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34086 (local address 127.2.55.189:45195)
0811 16:47:48.577791 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.577793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.577801 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:47:48.577825 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.577826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.577836 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.577891 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.578230 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.578716 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.579530 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.579790 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.579885 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.581588 (+ 1703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.581589 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.581590 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.581598 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.582779 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.583120 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.583121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.583121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.583172 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.583395 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.583395 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.583396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.583493 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.583543 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.583683 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.583748 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:47:48.584414 13111 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.188@KRBTEST.COM for oryx/127.2.55.188@KRBTEST.COM
I20260811 16:47:48.590811 13117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.584691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:44659 (local address 127.0.0.1:60582)
0811 16:47:48.584765 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.584789 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.584831 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.585075 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.585075 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.585188 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.585215 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.585216 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.585791 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.585791 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.586239 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.586240 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.586632 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.586632 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.586667 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.586997 (+ 330us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.587001 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.588083 (+ 1082us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.589851 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.589852 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.589852 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.590006 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.590214 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.590215 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.590219 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.590272 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.590497 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.590498 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.590543 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.590596 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.590710 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 16:47:48.590931 13118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.584797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60582 (local address 127.2.55.188:44659)
0811 16:47:48.584886 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.584888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.584896 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:47:48.584913 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.584914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.584924 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.584969 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.585274 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.585724 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.586326 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.586561 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.586625 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.588190 (+ 1565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.588192 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.588192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.588199 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.589776 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.590068 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.590069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.590069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.590135 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.590327 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.590328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.590328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.590422 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.590473 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.590619 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.590809 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":93,"server-negotiator.queue_time_us":70}
I20260811 16:47:48.592419 13111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: Bootstrap starting.
I20260811 16:47:48.593473 13111 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:48.593844 13111 log.cc:824] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:48.594594 13111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: No bootstrap required, opened a new log
I20260811 16:47:48.596078 13111 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } }
I20260811 16:47:48.596226 13111 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:48.596279 13111 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a2869c141d846539ffe3865d983537f, State: Initialized, Role: FOLLOWER
I20260811 16:47:48.596450 13111 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } }
I20260811 16:47:48.596894 13111 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:48.596824 13121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } } }
I20260811 16:47:48.596966 13121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [sys.catalog]: This master's current role is: FOLLOWER
W20260811 16:47:48.598794 13138 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:47:48.598857 13138 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:47:48.601275 13016 master_runner.cc:428] Detected that this master 7a2869c141d846539ffe3865d983537f is joining an existing cluster
I20260811 16:47:48.601325 13016 master_runner.cc:432] Initiating AddMaster RPC to add 127.2.55.188:44659
I20260811 16:47:48.630878 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 12115
I20260811 16:47:48.650048 12111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.602402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54202 (local address 127.2.55.190:32981)
0811 16:47:48.602456 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.602459 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.602576 (+ 117us) server_negotiation.cc:407] Connection header received
0811 16:47:48.602721 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.602722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.602735 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.602767 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.603506 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.604285 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.605482 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.606133 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.606168 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.646663 (+ 40495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.646666 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.646666 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.646677 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.648439 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.649035 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.649037 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.649037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.649105 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.649330 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.649331 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.649331 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.649494 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.649557 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.649812 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.649910 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:47:48.650966 13144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.602348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.0.0.1:54202)
0811 16:47:48.602517 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.602528 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.602637 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.602925 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.602925 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.603228 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.603407 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.603409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.604373 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.604374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.605380 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.605382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.606232 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.606232 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.606333 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.606744 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.606749 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.646475 (+ 39726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.648574 (+ 2099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.648576 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.648576 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.648929 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.649188 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.649189 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.649190 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.649252 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.649597 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.649598 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.649668 (+ 70us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.650608 (+ 940us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.650749 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":41,"thread_start_us":95,"threads_started":1}
I20260811 16:47:48.651104 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:37995
--local_ip_for_outbound_sockets=127.2.55.129
--tserver_master_addrs=127.2.55.190:32981
--webserver_port=39611
--webserver_interface=127.2.55.129
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.129.keytab
--principal=oryx/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.2.55.190:32981,127.2.55.189:45195
--tserver_master_addrs=127.2.55.190:32981,127.2.55.189:45195,127.2.55.188:44659 with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:47:48.652693 13118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.602537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60590 (local address 127.2.55.188:44659)
0811 16:47:48.602575 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.602578 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.602688 (+ 110us) server_negotiation.cc:407] Connection header received
0811 16:47:48.602763 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.602764 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.602772 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.602826 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.603249 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.603960 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.605139 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.605434 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.605473 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.606681 (+ 1208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.606683 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.606683 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.606690 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.648470 (+ 41780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.649422 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.649423 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.649424 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.649477 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.649664 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.649664 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.649665 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.649805 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.649847 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.652462 (+ 2615us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.652543 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:47:48.653781 12993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.602826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34092 (local address 127.2.55.189:45195)
0811 16:47:48.602867 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.602869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.603110 (+ 241us) server_negotiation.cc:407] Connection header received
0811 16:47:48.603205 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.603206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.603218 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.603248 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.603710 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.604407 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.605482 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.605787 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.605828 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.650095 (+ 44267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.650098 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.650098 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.650108 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.651985 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.652440 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.652442 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.652443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.652531 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.653116 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.653117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.653117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.653279 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.653329 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.653577 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.653667 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:47:48.654420 13150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.602581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:45195 (local address 127.0.0.1:34092)
0811 16:47:48.603052 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.603063 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.603133 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.603331 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.603332 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.603567 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.603622 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.603623 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.604495 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.604495 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.605380 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.605382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.605904 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.605905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.605973 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.647600 (+ 41627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.647605 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.649114 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.652095 (+ 2981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.652096 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.652096 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.652337 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.652634 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.652635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.652635 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.652710 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.653385 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.653386 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.653438 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.654072 (+ 634us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.654196 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"mutex_wait_us":4,"thread_start_us":74,"threads_started":1}
I20260811 16:47:48.655805 13148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.602401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:44659 (local address 127.0.0.1:60590)
0811 16:47:48.602633 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.602641 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.602709 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.602848 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.602849 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.603065 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.603147 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.603149 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.604047 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.604048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.605049 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.605052 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.605555 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.605555 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.605612 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.606101 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.606107 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.606561 (+ 454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.648577 (+ 42016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.648578 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.648579 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.649348 (+ 769us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.649538 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.649538 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.649539 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.649604 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.649890 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.649891 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.649938 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.652848 (+ 2910us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.652969 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":67,"threads_started":1}
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466867, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.190@KRBTEST.COM for oryx/127.2.55.188@KRBTEST.COM
I20260811 16:47:48.663836 12871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.655429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:44659 (local address 127.0.0.1:60598)
0811 16:47:48.655481 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.655491 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.655528 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.655743 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.655744 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.655928 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.655985 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.655987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.656984 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.656985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.657888 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.657893 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.658390 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.658391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.658474 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.658937 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.658944 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.660578 (+ 1634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.662582 (+ 2004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.662583 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.662584 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.662837 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.663081 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.663082 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.663082 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.663158 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.663476 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.663477 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.663530 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.663614 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.663731 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 16:47:48.663872 13118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.655500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60598 (local address 127.2.55.188:44659)
0811 16:47:48.655609 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.655611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.655618 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:47:48.655651 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.655652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.655663 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.655713 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.656085 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.656880 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.657989 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.658286 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.658371 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.660681 (+ 2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.660683 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.660684 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.660692 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.662482 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.662927 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.662929 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.662930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.662996 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.663237 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.663238 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.663238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.663387 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.663467 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.663665 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.663747 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 16:47:48.664896 12025 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.2.55.188:44659: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7a2869c141d846539ffe3865d983537f"
member_type: NON_VOTER
last_known_addr {
host: "127.2.55.188"
port: 44659
}
attrs {
promote: true
}
}
dest_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e"
cas_config_opid_index: 5
I20260811 16:47:48.665160 12025 consensus_queue.cc:237] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: NON_VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: true } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } }
I20260811 16:47:48.665637 12873 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 7a2869c141d846539ffe3865d983537f (127.2.55.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: NON_VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: true } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } } }
I20260811 16:47:48.666560 12873 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.2.55.188:44659
I20260811 16:47:48.666649 12873 sys_catalog.cc:455] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: NON_VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: true } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } } }
I20260811 16:47:48.666716 12873 sys_catalog.cc:458] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:48.666958 13016 master.cc:537] Master@127.2.55.188:44659 shutting down...
I20260811 16:47:48.667116 13080 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:48.668191 13080 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 1 FOLLOWER]: Refusing update from remote peer c15aa67b0c6b4e10bde14c83c174eb6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 16:47:48.668480 12872 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 16:47:48.669283 12002 consensus_peers.cc:487] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e -> Peer 7a2869c141d846539ffe3865d983537f (127.2.55.188:44659): Couldn't send request to peer 7a2869c141d846539ffe3865d983537f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:47:48.672041 13016 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:48.672144 13016 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:48.672192 13016 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: stopping tablet replica
I20260811 16:47:48.673668 12871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.665596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:45195 (local address 127.0.0.1:34102)
0811 16:47:48.669356 (+ 3760us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.669368 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.669412 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.669651 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.669653 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.669654 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:48.669699 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.669701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.670646 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.670648 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.672194 (+ 1546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.672197 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.673401 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.673402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.673470 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.673494 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.673540 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.673584 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3744}
I20260811 16:47:48.674286 12993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.665666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34102 (local address 127.2.55.189:45195)
0811 16:47:48.665715 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.665717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.669467 (+ 3750us) server_negotiation.cc:407] Connection header received
0811 16:47:48.669498 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.669499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.669525 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.669580 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:48.669767 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.670547 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.672320 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.673030 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.673081 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.673155 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.674172 (+ 1017us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.674216 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:47:48.674559 12938 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 1 LEARNER]: Refusing update from remote peer c15aa67b0c6b4e10bde14c83c174eb6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 16:47:48.674791 12872 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: NON_VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 16:47:48.675346 12938 raft_consensus.cc:2932] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 7a2869c141d846539ffe3865d983537f (127.2.55.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: NON_VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: true } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } } }
I20260811 16:47:48.676443 12994 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c15aa67b0c6b4e10bde14c83c174eb6e. Latest consensus state: current_term: 1 leader_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: NON_VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: true } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } } }
I20260811 16:47:48.676529 12994 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: This master's current role is: LEARNER
I20260811 16:47:48.676560 12994 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: NON_VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: true } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } } }
I20260811 16:47:48.676614 12994 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: This master's current role is: LEARNER
I20260811 16:47:48.676919 13016 master.cc:552] Master@127.2.55.188:44659 shutdown complete.
I20260811 16:47:48.677011 13016 master_runner.cc:305] Clearing existing system tablet
I20260811 16:47:48.677060 12872 raft_consensus.cc:1050] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e: attempting to promote NON_VOTER cb276d7b826c4576b9fb093714f25a04 to VOTER
I20260811 16:47:48.677243 13016 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:48.677279 12872 consensus_queue.cc:237] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } }
I20260811 16:47:48.677347 13016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:48.677802 12871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.677688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:44659 (local address 127.0.0.1:60604)
0811 16:47:48.677738 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.677774 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:44659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 16:47:48.677996 12938 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 1 LEARNER]: Refusing update from remote peer c15aa67b0c6b4e10bde14c83c174eb6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 16:47:48.678165 12873 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 16:47:48.678663 12871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.678485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:44659 (local address 127.0.0.1:60610)
0811 16:47:48.678606 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.678640 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:44659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
W20260811 16:47:48.678829 12002 consensus_peers.cc:487] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e -> Peer 7a2869c141d846539ffe3865d983537f (127.2.55.188:44659): Couldn't send request to peer 7a2869c141d846539ffe3865d983537f. Status: Network error: Client connection negotiation failed: client connection to 127.2.55.188:44659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:47:48.679234 12873 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, cb276d7b826c4576b9fb093714f25a04 (127.2.55.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } } }
I20260811 16:47:48.679381 12938 raft_consensus.cc:2932] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, cb276d7b826c4576b9fb093714f25a04 (127.2.55.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } } }
I20260811 16:47:48.680306 12872 sys_catalog.cc:455] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } } }
I20260811 16:47:48.680379 12872 sys_catalog.cc:458] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:48.680327 12873 sys_catalog.cc:455] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } } }
I20260811 16:47:48.680418 12873 sys_catalog.cc:458] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:48.680655 13154 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } } }
I20260811 16:47:48.680749 13154 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:48.681087 13016 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.001s
I20260811 16:47:48.681732 13159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.681875 13016 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:48.681942 13016 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:47:48.681973 13016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/wal
uuid: "7a2869c141d846539ffe3865d983537f"
format_stamp: "Formatted at 2026-08-11 16:47:48 on dist-test-slave-3h5h"
server_key: "a099092ab3a6fb4f394f198e09bb9adc"
server_key_iv: "e2c997d348df301e9729b47209d7acf2"
server_key_version: "encryptionkey@0"
I20260811 16:47:48.682811 13016 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:48.684325 13016 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 16:47:48.684393 13016 log.cc:1196] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 16:47:48.684638 13016 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: Deleting consensus metadata
I20260811 16:47:48.684784 13016 master_runner.cc:315] Copying system tablet from 127.2.55.190:32981
I20260811 16:47:48.685844 13016 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: tablet copy: Beginning tablet copy session from remote peer at address 127.2.55.190:32981
I20260811 16:47:48.693820 12111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.686333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54218 (local address 127.2.55.190:32981)
0811 16:47:48.686377 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.686379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.686391 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:47:48.686492 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.686492 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.686503 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.686555 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.686964 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.687725 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.688822 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.689141 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.689229 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.690557 (+ 1328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.690559 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.690559 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.690567 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.692385 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.692893 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.692895 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.692895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.692960 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.693201 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.693202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.693202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.693346 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.693419 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.693637 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.693733 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:47:48.693838 13167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.686204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.0.0.1:54218)
0811 16:47:48.686328 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.686340 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.686408 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.686576 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.686577 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.686822 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.686880 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.686882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.687820 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.687821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.688711 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.688715 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.689260 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.689262 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.689325 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.689877 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.689882 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.690351 (+ 469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.692495 (+ 2144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.692496 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.692497 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.692744 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.693042 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.693043 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.693044 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.693121 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.693429 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.693430 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.693503 (+ 73us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.693595 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.693733 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":74,"threads_started":1}
I20260811 16:47:48.694763 12056 tablet_copy_service.cc:140] P c15aa67b0c6b4e10bde14c83c174eb6e: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 7a2869c141d846539ffe3865d983537f ({username='oryx', principal='oryx/127.2.55.188@KRBTEST.COM'} at 127.0.0.1:54218)
I20260811 16:47:48.694832 12056 tablet_copy_service.cc:161] P c15aa67b0c6b4e10bde14c83c174eb6e: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 7a2869c141d846539ffe3865d983537f at {username='oryx', principal='oryx/127.2.55.188@KRBTEST.COM'} at 127.0.0.1:54218: session id = 7a2869c141d846539ffe3865d983537f-00000000000000000000000000000000
I20260811 16:47:48.695484 12056 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:47:48.696153 13016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 16:47:48.697896 13016 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: tablet copy: Starting download of 0 data blocks...
I20260811 16:47:48.698173 13016 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: tablet copy: Starting download of 1 WAL segments...
I20260811 16:47:48.699024 13016 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:47:48.700037 12056 tablet_copy_service.cc:342] P c15aa67b0c6b4e10bde14c83c174eb6e: Request end of tablet copy session 7a2869c141d846539ffe3865d983537f-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.2.55.188@KRBTEST.COM'} at 127.0.0.1:54218
I20260811 16:47:48.700094 12056 tablet_copy_service.cc:433] P c15aa67b0c6b4e10bde14c83c174eb6e: ending tablet copy session 7a2869c141d846539ffe3865d983537f-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 7a2869c141d846539ffe3865d983537f
I20260811 16:47:48.703461 13016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:48.704869 13171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:48.704962 13172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:48.705133 13175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:48.705639 13016 server_base.cc:1034] running on GCE node
I20260811 16:47:48.705768 13016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:48.705905 13016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:48.707024 13016 hybrid_clock.cc:648] HybridClock initialized: now 1786466868707001 us; error 43 us; skew 500 ppm
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:48.708758 13016 init.cc:377] Logged in from keytab as oryx/127.2.55.188@KRBTEST.COM (short username oryx)
I20260811 16:47:48.709154 13016 webserver.cc:460] Webserver started at http://127.2.55.188:39563/ using document root <none> and password file <none>
I20260811 16:47:48.709355 13016 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:48.709465 13016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:48.710418 13016 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:47:48.711263 13185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.711469 13016 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.711571 13016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/wal
uuid: "7a2869c141d846539ffe3865d983537f"
format_stamp: "Formatted at 2026-08-11 16:47:48 on dist-test-slave-3h5h"
server_key: "a099092ab3a6fb4f394f198e09bb9adc"
server_key_iv: "e2c997d348df301e9729b47209d7acf2"
server_key_version: "encryptionkey@0"
I20260811 16:47:48.711707 13016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:48.736356 13016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:48.738747 13016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:48.742441 13016 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.188:44659
I20260811 16:47:48.742487 13260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.188:44659 every 8 connection(s)
I20260811 16:47:48.743023 13016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/master-2/data/info.pb
I20260811 16:47:48.744199 13261 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:47:48.744768 13261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: Bootstrap starting.
I20260811 16:47:48.748165 13261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:47:48.748391 13261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: Bootstrap complete.
I20260811 16:47:48.748605 13261 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } }
I20260811 16:47:48.748706 13261 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7a2869c141d846539ffe3865d983537f, State: Initialized, Role: LEARNER
I20260811 16:47:48.748747 13261 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } }
I20260811 16:47:48.748996 13261 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:48.749006 13265 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } } }
I20260811 16:47:48.749269 13265 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [sys.catalog]: This master's current role is: LEARNER
I20260811 16:47:48.751772 13281 catalog_manager.cc:1259] Loaded cluster ID: ed0b8e4c96324510b4b71044242c7681
I20260811 16:47:48.751878 13281 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: loading cluster ID for follower catalog manager: success
I20260811 16:47:48.753069 13281 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: acquiring CA information for follower catalog manager: success
I20260811 16:47:48.753479 13281 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 16:47:48.756459 13151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:48.756642 13151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:48.756667 13151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:48.757891 13151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:48.757932 13151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:48.757961 13151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:47:48.759441 13151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.129.keytab
--principal=oryx/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:37995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=39611
--tserver_master_addrs=127.2.55.190:32981,127.2.55.189:45195,127.2.55.188:44659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:48.759673 13151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:48.759934 13151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:48.765352 13290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:48.765363 13288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:48.765365 13292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:48.765879 13151 server_base.cc:1034] running on GCE node
I20260811 16:47:48.766093 13151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:48.766335 13151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:48.767498 13151 hybrid_clock.cc:648] HybridClock initialized: now 1786466868767488 us; error 39 us; skew 500 ppm
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:48.770445 13151 init.cc:377] Logged in from keytab as oryx/127.2.55.129@KRBTEST.COM (short username oryx)
I20260811 16:47:48.770929 13151 webserver.cc:460] Webserver started at http://127.2.55.129:39611/ using document root <none> and password file <none>
I20260811 16:47:48.771212 13151 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:48.771320 13151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:48.773267 13151 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:47:48.774156 13306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.774367 13151 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:47:48.774487 13151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "d0d2941eac2a4299b74d9b1469d64c4a"
format_stamp: "Formatted at 2026-08-11 16:47:47 on dist-test-slave-3h5h"
server_key: "08405d7b46c722196f2c46b6be3aa50e"
server_key_iv: "4ba8a3b8ae848c4c41a4b0b72ec136e9"
server_key_version: "encryptionkey@0"
I20260811 16:47:48.774852 13151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:48.799134 13151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:48.801457 13151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:48.801676 13151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:48.801973 13151 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:48.802316 13151 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:48.802372 13151 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.802418 13151 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:48.802449 13151 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.810333 13151 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:37995
I20260811 16:47:48.810442 13478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:37995 every 8 connection(s)
I20260811 16:47:48.810781 13151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.189@KRBTEST.COM
I20260811 16:47:48.818710 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 13151
I20260811 16:47:48.818890 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 12318
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.188@KRBTEST.COM
I20260811 16:47:48.824115 12111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.811576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:37257 (local address 127.2.55.190:32981)
0811 16:47:48.811639 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.811641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.811936 (+ 295us) server_negotiation.cc:407] Connection header received
0811 16:47:48.813327 (+ 1391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.813329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.813345 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.813385 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.814230 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.814999 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.816191 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.816455 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.816543 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.819684 (+ 3141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.819686 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.819687 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.819694 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.822605 (+ 2911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.823074 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.823075 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.823076 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.823143 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.823355 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.823357 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.823357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.823478 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.823557 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.823914 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.823998 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:47:48.824261 12993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.811972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:58397 (local address 127.2.55.189:45195)
0811 16:47:48.812018 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.812020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.812134 (+ 114us) server_negotiation.cc:407] Connection header received
0811 16:47:48.813291 (+ 1157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.813292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.813306 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.813361 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.814208 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.814705 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.815714 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.815918 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.816004 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.819209 (+ 3205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.819211 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.819211 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.819220 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.822459 (+ 3239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.822975 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.822976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.822977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.823067 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.823590 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.823591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.823591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.823736 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.823810 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.824007 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.824113 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:47:48.824318 13490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.811585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.129:37257)
0811 16:47:48.811781 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.811833 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.813180 (+ 1347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.813471 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.813472 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.813889 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.814110 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.814112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.815106 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.815107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.816100 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.816103 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.816546 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.816547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.816626 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.817021 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.817025 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.819598 (+ 2573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.822695 (+ 3097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.822696 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.822697 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.822995 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.823200 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.823201 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.823201 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.823284 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.823547 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.823554 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.823745 (+ 191us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.823884 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.824066 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":5,"thread_start_us":97,"threads_started":1}
I20260811 16:47:48.824679 13491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.811883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:45195 (local address 127.2.55.129:58397)
0811 16:47:48.812073 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.812085 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.813185 (+ 1100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.813434 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.813438 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.813912 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.814106 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.814111 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.814815 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.814816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.815620 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.815622 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.816016 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.816017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.816141 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.816797 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.816804 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.819092 (+ 2288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.822557 (+ 3465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.822565 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.822568 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.822896 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.823126 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.823126 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.823127 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.823282 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.823817 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.823818 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.823869 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.824397 (+ 528us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.824520 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":64,"threads_started":1}
I20260811 16:47:48.825217 13482 heartbeater.cc:347] Connected to a master server at 127.2.55.189:45195
I20260811 16:47:48.825326 13482 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:48.825529 13482 heartbeater.cc:511] Master 127.2.55.189:45195 requested a full tablet report, sending...
I20260811 16:47:48.826097 12923 ts_manager.cc:194] Registered new tserver with Master: d0d2941eac2a4299b74d9b1469d64c4a (127.2.55.129:37995)
I20260811 16:47:48.829023 13481 heartbeater.cc:347] Connected to a master server at 127.2.55.190:32981
I20260811 16:47:48.829090 13481 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:48.829169 13481 heartbeater.cc:511] Master 127.2.55.190:32981 requested a full tablet report, sending...
I20260811 16:47:48.829303 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:46151
--local_ip_for_outbound_sockets=127.2.55.130
--tserver_master_addrs=127.2.55.190:32981
--webserver_port=40323
--webserver_interface=127.2.55.130
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.130.keytab
--principal=oryx/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.2.55.190:32981,127.2.55.189:45195
--tserver_master_addrs=127.2.55.190:32981,127.2.55.189:45195,127.2.55.188:44659 with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:47:48.831288 12025 ts_manager.cc:194] Re-registered known tserver with Master: d0d2941eac2a4299b74d9b1469d64c4a (127.2.55.129:37995)
I20260811 16:47:48.831820 12025 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:37257
I20260811 16:47:48.831946 13486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.811583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:47171 (local address 127.2.55.188:44659)
0811 16:47:48.811722 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.811724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.811935 (+ 211us) server_negotiation.cc:407] Connection header received
0811 16:47:48.813327 (+ 1392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.813329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.813345 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.813396 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.814231 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.815291 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.816268 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.816600 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.816675 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.829408 (+ 12733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.829410 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.829410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.829418 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.830771 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.831121 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.831122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.831123 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.831183 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.831394 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.831395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.831395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.831521 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.831596 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.831757 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.831845 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
I20260811 16:47:48.832171 13489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.811585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:44659 (local address 127.2.55.129:47171)
0811 16:47:48.811783 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.811833 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.813179 (+ 1346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.813471 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.813472 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.813911 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.814107 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.814113 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.815396 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.815397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.816199 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.816200 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.816739 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.816740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.816825 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.817242 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.817248 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.829284 (+ 12036us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.830863 (+ 1579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.830864 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.830865 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.831040 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.831266 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.831267 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.831267 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.831331 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.831598 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.831599 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.831642 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.831730 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.831839 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":94,"threads_started":1}
I20260811 16:47:48.832612 13479 heartbeater.cc:347] Connected to a master server at 127.2.55.188:44659
I20260811 16:47:48.832700 13479 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:48.832816 13479 heartbeater.cc:511] Master 127.2.55.188:44659 requested a full tablet report, sending...
I20260811 16:47:48.833266 13213 ts_manager.cc:194] Registered new tserver with Master: d0d2941eac2a4299b74d9b1469d64c4a (127.2.55.129:37995)
W20260811 16:47:48.915557 13492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:48.915766 13492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:48.915789 13492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:48.916940 13492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:48.916980 13492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:48.917006 13492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:47:48.918426 13492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.130.keytab
--principal=oryx/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:46151
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=40323
--tserver_master_addrs=127.2.55.190:32981,127.2.55.189:45195,127.2.55.188:44659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:48.918612 13492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:48.918792 13492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:48.923799 13497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:48.923784 13501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:48.923784 13499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:48.924167 13492 server_base.cc:1034] running on GCE node
I20260811 16:47:48.924398 13492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:48.924669 13492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:48.925828 13492 hybrid_clock.cc:648] HybridClock initialized: now 1786466868925824 us; error 42 us; skew 500 ppm
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:48.928264 13492 init.cc:377] Logged in from keytab as oryx/127.2.55.130@KRBTEST.COM (short username oryx)
I20260811 16:47:48.928690 13492 webserver.cc:460] Webserver started at http://127.2.55.130:40323/ using document root <none> and password file <none>
I20260811 16:47:48.928966 13492 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:48.929051 13492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:48.930444 13492 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:48.931054 13514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.931231 13492 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:48.931335 13492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "98acc595193142a68059dd161eb1a567"
format_stamp: "Formatted at 2026-08-11 16:47:47 on dist-test-slave-3h5h"
server_key: "0c49d0ab4b26b3da7a4dd27e42e0457e"
server_key_iv: "74c00c64dfcfe2c36c5620298ea35968"
server_key_version: "encryptionkey@0"
I20260811 16:47:48.931686 13492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:48.941520 13492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:48.943348 13492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:48.943512 13492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:48.943749 13492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:48.944114 13492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:48.944169 13492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.944222 13492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:48.944253 13492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:48.950958 13492 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:46151
I20260811 16:47:48.951041 13679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:46151 every 8 connection(s)
I20260811 16:47:48.951426 13492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:47:48.956303 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 13492
I20260811 16:47:48.956501 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 12525
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.189@KRBTEST.COM
I20260811 16:47:48.966442 12993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.952862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:57721 (local address 127.2.55.189:45195)
0811 16:47:48.952951 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.952953 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.952964 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:47:48.954115 (+ 1151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.954117 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.954130 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.954188 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.955023 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.955533 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.957582 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.957997 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.958050 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.962244 (+ 4194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.962246 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.962246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.962257 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.964083 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.965069 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.965072 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.965072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.965159 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.965548 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.965549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.965549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.965723 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.965784 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.966231 (+ 447us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.966327 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 16:47:48.966663 13687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.952345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:45195 (local address 127.2.55.130:57721)
0811 16:47:48.952533 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.952567 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.953825 (+ 1258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.954194 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.954195 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.954610 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.954916 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.954918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.955638 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.955639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.957457 (+ 1818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.957461 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.958163 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.958164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.958368 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.959772 (+ 1404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.959783 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.962122 (+ 2339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.964184 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.964196 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.964200 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.964924 (+ 724us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.965257 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.965258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.965258 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.965436 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.965823 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.965830 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.966043 (+ 213us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.966189 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.966382 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":51,"thread_start_us":80,"threads_started":1}
I20260811 16:47:48.967200 13682 heartbeater.cc:347] Connected to a master server at 127.2.55.189:45195
I20260811 16:47:48.967308 13682 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:48.967532 13682 heartbeater.cc:511] Master 127.2.55.189:45195 requested a full tablet report, sending...
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM
I20260811 16:47:48.968663 12923 ts_manager.cc:194] Registered new tserver with Master: 98acc595193142a68059dd161eb1a567 (127.2.55.130:46151)
Aug 11 16:47:48 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466868, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.188@KRBTEST.COM
I20260811 16:47:48.972189 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:41437
--local_ip_for_outbound_sockets=127.2.55.131
--tserver_master_addrs=127.2.55.190:32981
--webserver_port=38121
--webserver_interface=127.2.55.131
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.131.keytab
--principal=oryx/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.2.55.190:32981,127.2.55.189:45195
--tserver_master_addrs=127.2.55.190:32981,127.2.55.189:45195,127.2.55.188:44659 with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:47:48.972262 12111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.952819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:41777 (local address 127.2.55.190:32981)
0811 16:47:48.952907 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.952909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.952962 (+ 53us) server_negotiation.cc:407] Connection header received
0811 16:47:48.954254 (+ 1292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.954256 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.954271 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.954331 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.955038 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.955904 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.959784 (+ 3880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.960257 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.960358 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.968548 (+ 8190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.968551 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.968551 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.968561 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.970442 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.970878 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.970880 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.970880 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.970955 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.971218 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.971219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.971219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.971355 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.971767 (+ 412us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.972016 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.972129 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 16:47:48.973212 13689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.952720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.130:41777)
0811 16:47:48.952894 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.952904 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.953827 (+ 923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.954356 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.954356 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.954651 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.954877 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.954880 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.956005 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.956006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.959667 (+ 3661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.959670 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.960372 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.960373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.960449 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.966601 (+ 6152us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.966606 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.968406 (+ 1800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.970540 (+ 2134us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.970541 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.970541 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.970779 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.971054 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.971055 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.971056 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.971123 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.971758 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.971759 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.971836 (+ 77us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.972876 (+ 1040us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.973035 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":5,"thread_start_us":65,"threads_started":1}
I20260811 16:47:48.973610 13486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.952323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:57191 (local address 127.2.55.188:44659)
0811 16:47:48.952380 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:48.952383 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:48.952662 (+ 279us) server_negotiation.cc:407] Connection header received
0811 16:47:48.953963 (+ 1301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:48.953965 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:48.953980 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:48.954041 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:48.955002 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.955909 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.967294 (+ 11385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.967699 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.967750 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.970494 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:48.970496 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:48.970497 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:48.970506 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:48.972350 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.972710 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.972711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.972712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.972776 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:48.973034 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:48.973035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:48.973035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:48.973156 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:48.973237 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:48.973452 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 16:47:48.973546 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:47:48.973982 13686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:48.952344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:44659 (local address 127.2.55.130:57191)
0811 16:47:48.952519 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:48.952566 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:48.953826 (+ 1260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:48.954180 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:48.954185 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:48.954598 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:48.954868 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.954873 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.956034 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.956035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.966464 (+ 10429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:48.966468 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:48.967850 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:48.967851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:48.967936 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:48.968451 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:48.968457 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:48.970379 (+ 1922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:48.972434 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.972435 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.972435 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.972613 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.972886 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:48.972888 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:48.972888 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:48.972953 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:48.973230 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:48.973231 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:48.973312 (+ 81us) client_negotiation.cc:769] Sending connection context
0811 16:47:48.973719 (+ 407us) client_negotiation.cc:240] Negotiation successful
0811 16:47:48.973832 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":33,"thread_start_us":105,"threads_started":1}
I20260811 16:47:48.974597 13681 heartbeater.cc:347] Connected to a master server at 127.2.55.190:32981
I20260811 16:47:48.974665 13681 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:48.974746 13681 heartbeater.cc:511] Master 127.2.55.190:32981 requested a full tablet report, sending...
I20260811 16:47:48.974753 13680 heartbeater.cc:347] Connected to a master server at 127.2.55.188:44659
I20260811 16:47:48.974843 13680 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:48.974928 13680 heartbeater.cc:511] Master 127.2.55.188:44659 requested a full tablet report, sending...
I20260811 16:47:48.975046 12025 ts_manager.cc:194] Re-registered known tserver with Master: 98acc595193142a68059dd161eb1a567 (127.2.55.130:46151)
I20260811 16:47:48.975276 13213 ts_manager.cc:194] Registered new tserver with Master: 98acc595193142a68059dd161eb1a567 (127.2.55.130:46151)
I20260811 16:47:48.975538 12025 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:41777
W20260811 16:47:49.059501 13690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:49.059725 13690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:49.059751 13690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:49.060954 13690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:49.061036 13690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:49.061082 13690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:47:49.062742 13690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.131.keytab
--principal=oryx/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:41437
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=38121
--tserver_master_addrs=127.2.55.190:32981,127.2.55.189:45195,127.2.55.188:44659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:49.062945 13690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:49.063126 13690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:49.068256 13697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:49.068264 13698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:49.068421 13701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:49.068701 13690 server_base.cc:1034] running on GCE node
I20260811 16:47:49.068972 13690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:49.069200 13690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:49.070363 13690 hybrid_clock.cc:648] HybridClock initialized: now 1786466869070347 us; error 27 us; skew 500 ppm
Aug 11 16:47:49 dist-test-slave-3h5h krb5kdc[11950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466869, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:49.073031 13690 init.cc:377] Logged in from keytab as oryx/127.2.55.131@KRBTEST.COM (short username oryx)
I20260811 16:47:49.073542 13690 webserver.cc:460] Webserver started at http://127.2.55.131:38121/ using document root <none> and password file <none>
I20260811 16:47:49.073829 13690 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:49.073920 13690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:49.075284 13690 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:47:49.075912 13708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:49.076195 13690 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:49.076488 13690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "fc3d668aa13846cab5c2bd23cb8a49c8"
format_stamp: "Formatted at 2026-08-11 16:47:48 on dist-test-slave-3h5h"
server_key: "500a5cdb0583ad9642de9355469e56bb"
server_key_iv: "c9b8fee4db02fd4e909ff858b1cb4b00"
server_key_version: "encryptionkey@0"
I20260811 16:47:49.076997 13690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:49.095417 13690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:49.097692 13690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:49.097880 13690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:49.098157 13690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:49.098534 13690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:49.098608 13690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:49.098655 13690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:49.098688 13690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:49.105623 13690 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:41437
I20260811 16:47:49.105670 13861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:41437 every 8 connection(s)
I20260811 16:47:49.106122 13690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:47:49.108966 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 13690
Aug 11 16:47:49 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466869, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.189@KRBTEST.COM
Aug 11 16:47:49 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466869, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM
Aug 11 16:47:49 dist-test-slave-3h5h krb5kdc[11950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466869, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.188@KRBTEST.COM
I20260811 16:47:49.121084 12993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.107306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:35167 (local address 127.2.55.189:45195)
0811 16:47:49.107351 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:49.107353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:49.107415 (+ 62us) server_negotiation.cc:407] Connection header received
0811 16:47:49.108474 (+ 1059us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:49.108475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:49.108491 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:49.108529 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:49.109758 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.110817 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.112412 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.112719 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.112768 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.116388 (+ 3620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:49.116389 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:49.116390 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:49.116397 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:49.118207 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.119404 (+ 1197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.119406 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.119407 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.119481 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.119836 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.119837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.119837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.120010 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:49.120065 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:49.120814 (+ 749us) server_negotiation.cc:299] Negotiation successful
0811 16:47:49.120937 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:47:49.121769 13870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.107235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:45195 (local address 127.2.55.131:35167)
0811 16:47:49.107356 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:49.107367 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:49.108335 (+ 968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:49.108616 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:49.108617 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:49.109277 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:49.109607 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.109615 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.110915 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.110915 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.112276 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.112280 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.112892 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.112893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.113070 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.113789 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:49.113801 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:49.116264 (+ 2463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:49.118398 (+ 2134us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:49.118406 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:49.118410 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:49.119337 (+ 927us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:49.119587 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:49.119588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:49.119589 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:49.119742 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:49.120357 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:49.120364 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:49.120596 (+ 232us) client_negotiation.cc:769] Sending connection context
0811 16:47:49.121203 (+ 607us) client_negotiation.cc:240] Negotiation successful
0811 16:47:49.121432 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":52,"thread_start_us":64,"threads_started":1}
I20260811 16:47:49.121932 13486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.107016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:49413 (local address 127.2.55.188:44659)
0811 16:47:49.107177 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:49.107179 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:49.107246 (+ 67us) server_negotiation.cc:407] Connection header received
0811 16:47:49.108473 (+ 1227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:49.108475 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:49.108490 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:49.108540 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:49.109757 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.110784 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.114224 (+ 3440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.114574 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.114625 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.118822 (+ 4197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:49.118823 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:49.118824 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:49.118831 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:49.120675 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.121085 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.121086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.121098 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.121155 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.121377 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.121378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.121378 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.121502 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:49.121550 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:49.121761 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 16:47:49.121846 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135}
I20260811 16:47:49.122274 13868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.106896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:44659 (local address 127.2.55.131:49413)
0811 16:47:49.107103 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:49.107152 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:49.108330 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:49.108642 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:49.108643 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:49.109277 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:49.109610 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.109615 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.110911 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.110912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.114109 (+ 3197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.114112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.114720 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.114721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.114804 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.115615 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:49.115621 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:49.118746 (+ 3125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:49.120740 (+ 1994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:49.120741 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:49.120742 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:49.120988 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:49.121235 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:49.121236 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:49.121236 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:49.121299 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:49.121587 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:49.121588 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:49.121631 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 16:47:49.122056 (+ 425us) client_negotiation.cc:240] Negotiation successful
0811 16:47:49.122180 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":62,"thread_start_us":113,"threads_started":1}
I20260811 16:47:49.122288 13866 heartbeater.cc:347] Connected to a master server at 127.2.55.189:45195
I20260811 16:47:49.122392 13866 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:49.122648 13866 heartbeater.cc:511] Master 127.2.55.189:45195 requested a full tablet report, sending...
I20260811 16:47:49.123206 13862 heartbeater.cc:347] Connected to a master server at 127.2.55.188:44659
I20260811 16:47:49.123297 13862 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:49.123349 12923 ts_manager.cc:194] Registered new tserver with Master: fc3d668aa13846cab5c2bd23cb8a49c8 (127.2.55.131:41437)
I20260811 16:47:49.123382 13862 heartbeater.cc:511] Master 127.2.55.188:44659 requested a full tablet report, sending...
I20260811 16:47:49.123694 13213 ts_manager.cc:194] Registered new tserver with Master: fc3d668aa13846cab5c2bd23cb8a49c8 (127.2.55.131:41437)
I20260811 16:47:49.124172 12111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.106949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:47601 (local address 127.2.55.190:32981)
0811 16:47:49.107174 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:49.107177 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:49.107325 (+ 148us) server_negotiation.cc:407] Connection header received
0811 16:47:49.108448 (+ 1123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:49.108449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:49.108463 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:49.108534 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:49.109785 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.110546 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.112381 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.112717 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.112765 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.118442 (+ 5677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:49.118443 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:49.118444 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:49.118453 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:49.120791 (+ 2338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.123051 (+ 2260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.123053 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.123053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.123129 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.123481 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.123482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.123483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.123632 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:49.123683 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:49.123989 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 16:47:49.124076 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182}
I20260811 16:47:49.124189 13869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.106897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.131:47601)
0811 16:47:49.107247 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:49.107259 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:49.108329 (+ 1070us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:49.108611 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:49.108616 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:49.109285 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:49.109608 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.109616 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.110834 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.110835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.112276 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.112280 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.112903 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.112904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.113049 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.116014 (+ 2965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:49.116020 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:49.118343 (+ 2323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:49.122638 (+ 4295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:49.122639 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:49.122640 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:49.122921 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:49.123220 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:49.123221 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:49.123221 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:49.123357 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:49.123743 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:49.123744 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:49.123840 (+ 96us) client_negotiation.cc:769] Sending connection context
0811 16:47:49.123950 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 16:47:49.124076 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":3,"thread_start_us":117,"threads_started":1}
I20260811 16:47:49.124770 13881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.110643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38738 (local address 127.2.55.190:32981)
0811 16:47:49.111338 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:49.111339 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:49.111622 (+ 283us) server_negotiation.cc:407] Connection header received
0811 16:47:49.111647 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:49.111648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:49.111660 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:49.111719 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:49.113826 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.114573 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.118532 (+ 3959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.118845 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.118888 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.120545 (+ 1657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:49.120547 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:49.120547 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:49.120555 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:49.123493 (+ 2938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.123873 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.123875 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.123875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.123935 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.124155 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.124157 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.124157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.124286 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:49.124385 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:49.124560 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 16:47:49.124656 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":80,"threads_started":1}
I20260811 16:47:49.124790 13864 heartbeater.cc:347] Connected to a master server at 127.2.55.190:32981
I20260811 16:47:49.124866 13864 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:49.124948 13864 heartbeater.cc:511] Master 127.2.55.190:32981 requested a full tablet report, sending...
I20260811 16:47:49.125227 12023 ts_manager.cc:194] Re-registered known tserver with Master: fc3d668aa13846cab5c2bd23cb8a49c8 (127.2.55.131:41437)
I20260811 16:47:49.125707 12023 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:47601
I20260811 16:47:49.127050 13878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.110135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48460 (local address 127.2.55.188:44659)
0811 16:47:49.111300 (+ 1165us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:49.111302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:49.111311 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:49.111478 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:49.111479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:49.111495 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:49.111584 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:49.112502 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.113373 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.114501 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.114805 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.114862 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.116448 (+ 1586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:49.116449 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:49.116449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:49.116456 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:49.125536 (+ 9080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.125945 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.125946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.125947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.126034 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.126243 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.126244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.126245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.126390 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:49.126486 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:49.126882 (+ 396us) server_negotiation.cc:299] Negotiation successful
0811 16:47:49.126963 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1141,"thread_start_us":63,"threads_started":1}
I20260811 16:47:49.128648 13883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.110844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48402 (local address 127.2.55.189:45195)
0811 16:47:49.111391 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:49.111393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:49.112316 (+ 923us) server_negotiation.cc:407] Connection header received
0811 16:47:49.112452 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:49.112453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:49.112465 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:49.112504 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:49.115704 (+ 3200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.116492 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.119211 (+ 2719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.119944 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.120801 (+ 857us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.124614 (+ 3813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:49.124616 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:49.124616 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:49.124624 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:49.127526 (+ 2902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.127931 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.127933 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.127933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.127991 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.128220 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.128221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.128221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.128322 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:49.128391 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:49.128522 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 16:47:49.128588 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":62,"threads_started":1}
I20260811 16:47:49.126663 12023 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38738:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:47:49.129102 12023 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:49.137142 12871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.132805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:41437 (local address 127.0.0.1:54020)
0811 16:47:49.133116 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:49.133127 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:49.133164 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:49.133660 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:49.133661 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:49.133663 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:49.133713 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.133715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.135031 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.135032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.136016 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.136019 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.136934 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.136936 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.136997 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.137001 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:49.137032 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 16:47:49.137072 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":43}
I20260811 16:47:49.137562 13899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.133246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54020 (local address 127.2.55.131:41437)
0811 16:47:49.133456 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:49.133459 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:49.133469 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:47:49.133523 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:49.133526 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:49.133544 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:49.133656 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:49.133780 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.134932 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.136118 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.136788 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.137335 (+ 547us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.137418 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:49.137443 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 16:47:49.137481 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":86,"threads_started":1}
I20260811 16:47:49.137652 13892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.132982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:37995 (local address 127.0.0.1:35402)
0811 16:47:49.133726 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:49.133735 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:49.133789 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:49.133987 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:49.133988 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:49.133990 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:49.134026 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.134027 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.135105 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.135106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.136271 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.136274 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.137398 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.137399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.137464 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.137468 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:49.137520 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 16:47:49.137558 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"mutex_wait_us":2,"thread_start_us":92,"threads_started":1}
I20260811 16:47:49.137902 13898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.133116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35402 (local address 127.2.55.129:37995)
0811 16:47:49.133450 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:49.133456 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:49.133814 (+ 358us) server_negotiation.cc:407] Connection header received
0811 16:47:49.133868 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:49.133870 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:49.133886 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:49.133989 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:49.134085 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.135005 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.136361 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.137204 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.137278 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.137362 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:49.137766 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 16:47:49.137821 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":100,"threads_started":1}
I20260811 16:47:49.138294 13894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.132884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:46151 (local address 127.0.0.1:43688)
0811 16:47:49.133567 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:49.133580 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:49.133629 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:49.134089 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:49.134090 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:49.134092 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:49.134138 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.134140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.135400 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.135401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.136474 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.136476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.138048 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.138050 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.138120 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.138128 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 16:47:49.138192 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:47:49.138232 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":645,"thread_start_us":91,"threads_started":1}
I20260811 16:47:49.138345 13896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.132979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43688 (local address 127.2.55.130:46151)
0811 16:47:49.133916 (+ 937us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:49.133920 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:49.133930 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:47:49.133969 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:49.133971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:49.133986 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:49.134230 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:49.134294 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.135297 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.136554 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.137223 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.137437 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.137598 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:49.138212 (+ 614us) server_negotiation.cc:299] Negotiation successful
0811 16:47:49.138260 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":898,"thread_start_us":98,"threads_started":1}
I20260811 16:47:49.138417 13777 tablet_service.cc:1467] Processing CreateTablet for tablet 07ac49884a9d4de797434ba4d9a10c10 (DEFAULT_TABLE table=test-table [id=734ab2029290465e8bcfd0762d32c31a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:49.138819 13777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07ac49884a9d4de797434ba4d9a10c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:49.138892 13586 tablet_service.cc:1467] Processing CreateTablet for tablet 07ac49884a9d4de797434ba4d9a10c10 (DEFAULT_TABLE table=test-table [id=734ab2029290465e8bcfd0762d32c31a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:49.139292 13586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07ac49884a9d4de797434ba4d9a10c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:49.141559 13383 tablet_service.cc:1467] Processing CreateTablet for tablet 07ac49884a9d4de797434ba4d9a10c10 (DEFAULT_TABLE table=test-table [id=734ab2029290465e8bcfd0762d32c31a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:49.141916 13383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07ac49884a9d4de797434ba4d9a10c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:49.142474 13900 tablet_bootstrap.cc:492] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8: Bootstrap starting.
I20260811 16:47:49.142843 13901 tablet_bootstrap.cc:492] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567: Bootstrap starting.
I20260811 16:47:49.143270 13900 tablet_bootstrap.cc:654] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:49.143651 13901 tablet_bootstrap.cc:654] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:49.143646 13900 log.cc:824] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:49.144129 13901 log.cc:824] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:49.144567 13900 tablet_bootstrap.cc:492] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8: No bootstrap required, opened a new log
I20260811 16:47:49.144661 13900 ts_tablet_manager.cc:1397] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:47:49.145138 13901 tablet_bootstrap.cc:492] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567: No bootstrap required, opened a new log
I20260811 16:47:49.145293 13901 ts_tablet_manager.cc:1397] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:47:49.146075 13907 tablet_bootstrap.cc:492] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a: Bootstrap starting.
I20260811 16:47:49.146783 13907 tablet_bootstrap.cc:654] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:49.147167 13907 log.cc:824] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:49.147063 13900 raft_consensus.cc:348] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } }
I20260811 16:47:49.147225 13900 raft_consensus.cc:374] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:49.147280 13900 raft_consensus.cc:729] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc3d668aa13846cab5c2bd23cb8a49c8, State: Initialized, Role: FOLLOWER
I20260811 16:47:49.147428 13900 consensus_queue.cc:260] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } }
I20260811 16:47:49.147774 13864 heartbeater.cc:503] Master 127.2.55.190:32981 was elected leader, sending a full tablet report...
I20260811 16:47:49.148016 13900 ts_tablet_manager.cc:1428] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 16:47:49.148353 13901 raft_consensus.cc:348] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } }
I20260811 16:47:49.148499 13901 raft_consensus.cc:374] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:49.148535 13901 raft_consensus.cc:729] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98acc595193142a68059dd161eb1a567, State: Initialized, Role: FOLLOWER
I20260811 16:47:49.148696 13901 consensus_queue.cc:260] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } }
I20260811 16:47:49.148995 13901 ts_tablet_manager.cc:1428] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 16:47:49.149341 13681 heartbeater.cc:503] Master 127.2.55.190:32981 was elected leader, sending a full tablet report...
I20260811 16:47:49.150085 13907 tablet_bootstrap.cc:492] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a: No bootstrap required, opened a new log
I20260811 16:47:49.150162 13907 ts_tablet_manager.cc:1397] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 16:47:49.152343 13907 raft_consensus.cc:348] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } }
I20260811 16:47:49.152486 13907 raft_consensus.cc:374] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:49.152534 13907 raft_consensus.cc:729] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2941eac2a4299b74d9b1469d64c4a, State: Initialized, Role: FOLLOWER
I20260811 16:47:49.152652 13907 consensus_queue.cc:260] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } }
I20260811 16:47:49.152968 13907 ts_tablet_manager.cc:1428] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 16:47:49.153019 13481 heartbeater.cc:503] Master 127.2.55.190:32981 was elected leader, sending a full tablet report...
W20260811 16:47:49.203015 13684 tablet.cc:2369] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:47:49.294432 13878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.291765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48462 (local address 127.2.55.188:44659)
0811 16:47:49.291834 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:49.291837 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:49.291861 (+ 24us) server_negotiation.cc:407] Connection header received
0811 16:47:49.291901 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:49.291902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:49.291924 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:49.292001 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:49.292184 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.292701 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.293646 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.294073 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.294164 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.294255 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:49.294304 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 16:47:49.294351 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 16:47:49.294432 13894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.291620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:44659 (local address 127.0.0.1:48462)
0811 16:47:49.291713 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:49.291727 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:49.291810 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:49.292010 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:49.292012 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:49.292013 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:49.292077 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.292080 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.292795 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.292796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.293543 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.293545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.294168 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.294170 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.294233 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.294237 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:49.294290 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 16:47:49.294352 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 16:47:49.294898 13227 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260811 16:47:49.295895 13913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c15aa67b0c6b4e10bde14c83c174eb6e. Latest consensus state: current_term: 1 leader_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } } }
I20260811 16:47:49.296080 13913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [sys.catalog]: This master's current role is: LEARNER
W20260811 16:47:49.311821 13483 tablet.cc:2369] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:47:49.357055 13867 tablet.cc:2369] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:47:49.429697 13912 raft_consensus.cc:482] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:49.429860 13912 raft_consensus.cc:504] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } }
I20260811 16:47:49.430356 13912 leader_election.cc:288] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc3d668aa13846cab5c2bd23cb8a49c8 (127.2.55.131:41437), 98acc595193142a68059dd161eb1a567 (127.2.55.130:46151)
I20260811 16:47:49.433748 13920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.430512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:41437 (local address 127.2.55.129:44167)
0811 16:47:49.430693 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:49.430705 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:49.430786 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:49.430966 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:49.430967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:49.430970 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:49.431038 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.431040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.431872 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.431873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.432801 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.432804 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.433441 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.433442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.433530 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.433535 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:47:49.433587 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 16:47:49.433623 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":51,"thread_start_us":96,"threads_started":1}
I20260811 16:47:49.433779 13899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.430612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:44167 (local address 127.2.55.131:41437)
0811 16:47:49.430675 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:49.430677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:49.430801 (+ 124us) server_negotiation.cc:407] Connection header received
0811 16:47:49.430861 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:49.430863 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:49.430880 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:49.430973 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:49.431126 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.431781 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.432954 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.433349 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.433412 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.433421 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:49.433617 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 16:47:49.433668 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 16:47:49.433861 13896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.430685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:52847 (local address 127.2.55.130:46151)
0811 16:47:49.430743 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:49.430745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:49.430837 (+ 92us) server_negotiation.cc:407] Connection header received
0811 16:47:49.430895 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:49.430896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:49.430906 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:49.430982 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:49.431485 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.432041 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.433044 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.433434 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.433508 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.433517 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:49.433731 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 16:47:49.433785 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 16:47:49.433907 13919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.430558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:46151 (local address 127.2.55.129:52847)
0811 16:47:49.430716 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:49.430728 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:49.430830 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:49.431136 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:49.431137 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:49.431140 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:49.431374 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.431377 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.432140 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.432141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.432958 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:49.432961 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.433534 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.433535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:49.433626 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.433630 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:49.433715 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 16:47:49.433758 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":79,"threads_started":1}
I20260811 16:47:49.434599 13802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07ac49884a9d4de797434ba4d9a10c10" candidate_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" is_pre_election: true
I20260811 16:47:49.434577 13614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07ac49884a9d4de797434ba4d9a10c10" candidate_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98acc595193142a68059dd161eb1a567" is_pre_election: true
I20260811 16:47:49.434760 13802 raft_consensus.cc:2454] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0d2941eac2a4299b74d9b1469d64c4a in term 0.
I20260811 16:47:49.434760 13614 raft_consensus.cc:2454] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0d2941eac2a4299b74d9b1469d64c4a in term 0.
I20260811 16:47:49.435025 13309 leader_election.cc:302] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0d2941eac2a4299b74d9b1469d64c4a, fc3d668aa13846cab5c2bd23cb8a49c8; no voters:
I20260811 16:47:49.435170 13912 raft_consensus.cc:2781] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:49.435231 13912 raft_consensus.cc:482] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:49.435257 13912 raft_consensus.cc:3037] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:49.436033 13912 raft_consensus.cc:504] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } }
I20260811 16:47:49.436187 13912 leader_election.cc:288] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [CANDIDATE]: Term 1 election: Requested vote from peers fc3d668aa13846cab5c2bd23cb8a49c8 (127.2.55.131:41437), 98acc595193142a68059dd161eb1a567 (127.2.55.130:46151)
I20260811 16:47:49.436342 13802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07ac49884a9d4de797434ba4d9a10c10" candidate_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8"
I20260811 16:47:49.436383 13614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07ac49884a9d4de797434ba4d9a10c10" candidate_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98acc595193142a68059dd161eb1a567"
I20260811 16:47:49.436432 13802 raft_consensus.cc:3037] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:49.436450 13614 raft_consensus.cc:3037] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:49.437361 13614 raft_consensus.cc:2454] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2941eac2a4299b74d9b1469d64c4a in term 1.
I20260811 16:47:49.437361 13802 raft_consensus.cc:2454] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2941eac2a4299b74d9b1469d64c4a in term 1.
I20260811 16:47:49.437613 13309 leader_election.cc:302] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0d2941eac2a4299b74d9b1469d64c4a, fc3d668aa13846cab5c2bd23cb8a49c8; no voters:
I20260811 16:47:49.437713 13912 raft_consensus.cc:2781] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:49.437826 13912 raft_consensus.cc:686] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [term 1 LEADER]: Becoming Leader. State: Replica: d0d2941eac2a4299b74d9b1469d64c4a, State: Running, Role: LEADER
I20260811 16:47:49.437934 13912 consensus_queue.cc:237] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } }
I20260811 16:47:49.438995 12023 catalog_manager.cc:5495] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a reported cstate change: term changed from 0 to 1, leader changed from <none> to d0d2941eac2a4299b74d9b1469d64c4a (127.2.55.129). New cstate: current_term: 1 leader_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } health_report { overall_health: HEALTHY } } }
I20260811 16:47:49.439692 13158 sys_catalog.cc:455] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: NON_VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: true } } }
I20260811 16:47:49.439785 13158 sys_catalog.cc:458] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:49.440759 13158 raft_consensus.cc:1050] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e: attempting to promote NON_VOTER 7a2869c141d846539ffe3865d983537f to VOTER
I20260811 16:47:49.440922 13158 consensus_queue.cc:237] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } }
I20260811 16:47:49.441351 13227 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 1 LEARNER]: Refusing update from remote peer c15aa67b0c6b4e10bde14c83c174eb6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 16:47:49.441388 12938 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 1 FOLLOWER]: Refusing update from remote peer c15aa67b0c6b4e10bde14c83c174eb6e: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 16:47:49.441632 13155 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 16:47:49.441828 13155 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 16:47:49.442421 13158 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 7a2869c141d846539ffe3865d983537f (127.2.55.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } } }
I20260811 16:47:49.442571 12938 raft_consensus.cc:2932] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 7a2869c141d846539ffe3865d983537f (127.2.55.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } } }
I20260811 16:47:49.442641 13227 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 7a2869c141d846539ffe3865d983537f (127.2.55.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } } }
I20260811 16:47:49.443420 13158 sys_catalog.cc:455] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } } }
I20260811 16:47:49.443519 13158 sys_catalog.cc:458] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:49.443578 13158 sys_catalog.cc:455] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } } }
I20260811 16:47:49.443639 13158 sys_catalog.cc:458] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:49.443683 13158 sys_catalog.cc:455] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } } }
I20260811 16:47:49.443729 13158 sys_catalog.cc:458] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:49.443738 13913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } } }
I20260811 16:47:49.443816 13913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:49.443814 13924 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } } }
I20260811 16:47:49.443892 13924 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:49.490715 13898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.488215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35414 (local address 127.2.55.129:37995)
0811 16:47:49.488278 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:49.488280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:49.488290 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:47:49.488330 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:49.488331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:49.488352 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:49.488417 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:49.488530 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.489081 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.489893 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.490108 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.490164 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.490306 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:49.490450 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:49.490528 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:49.490561 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 16:47:49.490580 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:47:49.492712 13802 raft_consensus.cc:1261] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 1 FOLLOWER]: Refusing update from remote peer d0d2941eac2a4299b74d9b1469d64c4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:49.492713 13614 raft_consensus.cc:1261] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567 [term 1 FOLLOWER]: Refusing update from remote peer d0d2941eac2a4299b74d9b1469d64c4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:49.493206 13921 consensus_queue.cc:1035] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:49.493338 13912 consensus_queue.cc:1035] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:49.496532 13928 mvcc.cc:205] Tried to move back new op lower bound from 7317368297439199232 to 7317368297218375680. Current Snapshot: MvccSnapshot[applied={T|T < 7317368297439199232}]
I20260811 16:47:49.498452 12023 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38738:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:49.498549 12023 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38738:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:49.498904 13930 mvcc.cc:205] Tried to move back new op lower bound from 7317368297439199232 to 7317368297218375680. Current Snapshot: MvccSnapshot[applied={T|T < 7317368297439199232}]
I20260811 16:47:49.500612 12023 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c15aa67b0c6b4e10bde14c83c174eb6e: Sending DeleteTablet for 3 replicas of tablet 07ac49884a9d4de797434ba4d9a10c10
I20260811 16:47:49.500957 13383 tablet_service.cc:1514] Processing DeleteTablet for tablet 07ac49884a9d4de797434ba4d9a10c10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:49 UTC) from {username='oryx', principal='oryx/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:35402
I20260811 16:47:49.501045 13586 tablet_service.cc:1514] Processing DeleteTablet for tablet 07ac49884a9d4de797434ba4d9a10c10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:49 UTC) from {username='oryx', principal='oryx/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:43688
I20260811 16:47:49.501245 13945 tablet_replica.cc:330] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567: stopping tablet replica
I20260811 16:47:49.501374 13945 raft_consensus.cc:2229] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:49.501521 13945 raft_consensus.cc:2258] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:49.501986 13945 ts_tablet_manager.cc:1905] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:49.502377 13777 tablet_service.cc:1514] Processing DeleteTablet for tablet 07ac49884a9d4de797434ba4d9a10c10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:49 UTC) from {username='oryx', principal='oryx/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:54020
I20260811 16:47:49.503013 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 11974
I20260811 16:47:49.504004 13947 tablet_replica.cc:330] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8: stopping tablet replica
I20260811 16:47:49.504127 13947 raft_consensus.cc:2229] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:49.504225 13947 raft_consensus.cc:2258] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:49.507408 13945 ts_tablet_manager.cc:1918] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:49.507542 13945 log.cc:1196] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/07ac49884a9d4de797434ba4d9a10c10
I20260811 16:47:49.507948 13945 ts_tablet_manager.cc:1939] T 07ac49884a9d4de797434ba4d9a10c10 P 98acc595193142a68059dd161eb1a567: Deleting consensus metadata
I20260811 16:47:49.512485 13947 ts_tablet_manager.cc:1905] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:49.514711 13947 ts_tablet_manager.cc:1918] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:49.514792 13947 log.cc:1196] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/07ac49884a9d4de797434ba4d9a10c10
I20260811 16:47:49.515085 13947 ts_tablet_manager.cc:1939] T 07ac49884a9d4de797434ba4d9a10c10 P fc3d668aa13846cab5c2bd23cb8a49c8: Deleting consensus metadata
I20260811 16:47:49.515602 13944 tablet_replica.cc:330] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a: stopping tablet replica
I20260811 16:47:49.515725 13944 raft_consensus.cc:2229] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:47:49.515843 13944 raft_consensus.cc:2258] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:49.516342 13944 ts_tablet_manager.cc:1905] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:49.518415 13944 ts_tablet_manager.cc:1918] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:49.518502 13944 log.cc:1196] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-0/wal/wals/07ac49884a9d4de797434ba4d9a10c10
I20260811 16:47:49.518781 13944 ts_tablet_manager.cc:1939] T 07ac49884a9d4de797434ba4d9a10c10 P d0d2941eac2a4299b74d9b1469d64c4a: Deleting consensus metadata
I20260811 16:47:49.519325 13878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.501628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48470 (local address 127.2.55.188:44659)
0811 16:47:49.501670 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:49.501672 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:49.501691 (+ 19us) server_negotiation.cc:407] Connection header received
0811 16:47:49.501712 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:49.501713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:49.501723 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:49.501779 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:49.512056 (+ 10277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.512952 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.514097 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.514411 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.514489 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.516288 (+ 1799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:49.516290 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:49.516290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:49.516298 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:49.518027 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.518430 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.518431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.518432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.518489 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.518709 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.518710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.518711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.518846 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:49.518921 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:49.519133 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 16:47:49.519221 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 16:47:49.519987 13308 connection.cc:535] server connection from 127.0.0.1:35402 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 16:47:49.520255 13519 connection.cc:535] server connection from 127.0.0.1:43688 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 16:47:49.520328 13712 connection.cc:535] server connection from 127.0.0.1:54020 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 16:47:49.528708 13878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.521816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48486 (local address 127.2.55.188:44659)
0811 16:47:49.521855 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:49.521857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:49.522206 (+ 349us) server_negotiation.cc:407] Connection header received
0811 16:47:49.522362 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:49.522369 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:49.522379 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:49.522409 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:49.523206 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.523900 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.524624 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.524816 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.524915 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.526066 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:49.526067 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:49.526067 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:49.526075 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:49.527598 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.527956 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.527957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.527958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.528012 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.528222 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.528223 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.528224 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.528335 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:49.528439 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:49.528535 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 16:47:49.528609 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:47:49.529973 13883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:49.522112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48406 (local address 127.2.55.189:45195)
0811 16:47:49.522168 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:49.522170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:49.522320 (+ 150us) server_negotiation.cc:407] Connection header received
0811 16:47:49.522410 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:49.522412 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:49.522436 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:49.522483 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:49.523033 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.523841 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.524943 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:49.525560 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:49.525629 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:49.527025 (+ 1396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:49.527026 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:49.527026 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:49.527034 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:49.528709 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.529314 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.529316 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.529316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.529381 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:49.529548 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:49.529549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:49.529549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:49.529645 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:49.529710 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:49.529848 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 16:47:49.529915 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 16:47:50.498307 13958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:50.498031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.131:46049)
0811 16:47:50.498178 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:50.498261 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":64,"threads_started":1}
W20260811 16:47:50.498602 13864 heartbeater.cc:644] Failed to heartbeat to 127.2.55.190:32981 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
I20260811 16:47:50.502754 13959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:50.502521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.130:59073)
0811 16:47:50.502642 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:50.502712 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":56,"threads_started":1}
W20260811 16:47:50.502983 13681 heartbeater.cc:644] Failed to heartbeat to 127.2.55.190:32981 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
I20260811 16:47:50.503227 13960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:50.502946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.129:40397)
0811 16:47:50.503099 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:50.503184 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":56,"threads_started":1}
W20260811 16:47:50.503475 13481 heartbeater.cc:644] Failed to heartbeat to 127.2.55.190:32981 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
I20260811 16:47:51.000821 13962 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c15aa67b0c6b4e10bde14c83c174eb6e)
I20260811 16:47:51.001044 13962 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } }
I20260811 16:47:51.001348 13962 leader_election.cc:288] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c15aa67b0c6b4e10bde14c83c174eb6e (127.2.55.190:32981), cb276d7b826c4576b9fb093714f25a04 (127.2.55.189:45195)
I20260811 16:47:51.001690 13967 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c15aa67b0c6b4e10bde14c83c174eb6e)
I20260811 16:47:51.001770 13965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.001516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.0.0.1:39162)
0811 16:47:51.001657 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.001715 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":93,"threads_started":1}
W20260811 16:47:51.001910 13189 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
I20260811 16:47:51.002056 13967 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } }
I20260811 16:47:51.002357 13968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.002219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.0.0.1:39164)
0811 16:47:51.002254 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.002297 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260811 16:47:51.002440 13189 leader_election.cc:334] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c15aa67b0c6b4e10bde14c83c174eb6e (127.2.55.190:32981): Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
I20260811 16:47:51.002381 13967 leader_election.cc:288] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c15aa67b0c6b4e10bde14c83c174eb6e (127.2.55.190:32981), 7a2869c141d846539ffe3865d983537f (127.2.55.188:44659)
I20260811 16:47:51.002673 13971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.002473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.0.0.1:39180)
0811 16:47:51.002581 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.002636 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":45,"threads_started":1}
W20260811 16:47:51.002791 12906 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
I20260811 16:47:51.003336 13971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.003228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.0.0.1:39186)
0811 16:47:51.003283 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.003312 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 16:47:51.003422 12906 leader_election.cc:334] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c15aa67b0c6b4e10bde14c83c174eb6e (127.2.55.190:32981): Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
I20260811 16:47:51.005292 13965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.001732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:45195 (local address 127.0.0.1:48408)
0811 16:47:51.001860 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.001870 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:51.001935 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:51.002194 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:51.002196 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:51.002200 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:51.002260 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:51.002263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.003494 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.003495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:51.004457 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:51.004460 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.005100 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.005101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:51.005155 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:51.005159 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:51.005213 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 16:47:51.005246 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":53,"threads_started":1}
I20260811 16:47:51.005336 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.001844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48408 (local address 127.2.55.189:45195)
0811 16:47:51.001977 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:51.001979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:51.001990 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:47:51.002023 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:51.002024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:51.002035 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:51.002120 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:51.002356 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.003386 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.004537 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.005018 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.005090 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:51.005103 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:51.005235 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 16:47:51.005274 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":52,"threads_started":1}
I20260811 16:47:51.005613 12938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7a2869c141d846539ffe3865d983537f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "cb276d7b826c4576b9fb093714f25a04" is_pre_election: true
I20260811 16:47:51.005749 12938 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a2869c141d846539ffe3865d983537f in term 1.
I20260811 16:47:51.005903 13972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.002500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:44659 (local address 127.0.0.1:48490)
0811 16:47:51.002670 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.002710 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:51.002834 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:51.003059 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:51.003059 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:51.003061 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:51.003098 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:51.003100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.004064 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.004065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:51.004817 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:51.004819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.005636 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.005637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:51.005699 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:51.005703 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:51.005766 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 16:47:51.005811 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":59,"threads_started":1}
I20260811 16:47:51.005895 13973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.002645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48490 (local address 127.2.55.188:44659)
0811 16:47:51.002773 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:51.002775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:51.002783 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:47:51.002931 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:51.002932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:51.002944 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:51.003005 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:51.003182 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.003981 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.004968 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.005555 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.005633 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:51.005645 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:51.005783 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 16:47:51.005828 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":85,"threads_started":1}
I20260811 16:47:51.005903 13189 leader_election.cc:302] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a2869c141d846539ffe3865d983537f, cb276d7b826c4576b9fb093714f25a04; no voters: c15aa67b0c6b4e10bde14c83c174eb6e
I20260811 16:47:51.006152 13962 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:47:51.006218 13962 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 1 FOLLOWER]: Starting leader election (detected failure of leader c15aa67b0c6b4e10bde14c83c174eb6e)
I20260811 16:47:51.006172 13227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cb276d7b826c4576b9fb093714f25a04" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7a2869c141d846539ffe3865d983537f" is_pre_election: true
I20260811 16:47:51.006266 13962 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:47:51.006986 13962 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } }
I20260811 16:47:51.007145 13962 leader_election.cc:288] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [CANDIDATE]: Term 2 election: Requested vote from peers c15aa67b0c6b4e10bde14c83c174eb6e (127.2.55.190:32981), cb276d7b826c4576b9fb093714f25a04 (127.2.55.189:45195)
I20260811 16:47:51.007161 13227 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb276d7b826c4576b9fb093714f25a04 in current term 2: Already voted for candidate 7a2869c141d846539ffe3865d983537f in this term.
I20260811 16:47:51.007357 13965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.007228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.0.0.1:39196)
0811 16:47:51.007303 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.007334 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 16:47:51.007395 12905 leader_election.cc:302] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb276d7b826c4576b9fb093714f25a04; no voters: 7a2869c141d846539ffe3865d983537f, c15aa67b0c6b4e10bde14c83c174eb6e
I20260811 16:47:51.007503 13967 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:47:51.007556 12938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7a2869c141d846539ffe3865d983537f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "cb276d7b826c4576b9fb093714f25a04"
I20260811 16:47:51.007682 13965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.007608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.0.0.1:39208)
0811 16:47:51.007638 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.007662 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260811 16:47:51.007762 13189 leader_election.cc:334] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c15aa67b0c6b4e10bde14c83c174eb6e (127.2.55.190:32981): Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
I20260811 16:47:51.008260 13967 raft_consensus.cc:2726] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:47:51.009007 12938 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a2869c141d846539ffe3865d983537f in term 2.
I20260811 16:47:51.009207 13189 leader_election.cc:302] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a2869c141d846539ffe3865d983537f, cb276d7b826c4576b9fb093714f25a04; no voters: c15aa67b0c6b4e10bde14c83c174eb6e
I20260811 16:47:51.009338 13962 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:47:51.009519 13962 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [term 2 LEADER]: Becoming Leader. State: Replica: 7a2869c141d846539ffe3865d983537f, State: Running, Role: LEADER
I20260811 16:47:51.009613 13962 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } }
I20260811 16:47:51.010038 13976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a2869c141d846539ffe3865d983537f. Latest consensus state: current_term: 2 leader_uuid: "7a2869c141d846539ffe3865d983537f" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } } }
I20260811 16:47:51.010151 13976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:51.010334 13979 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:51.011111 13979 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:51.011224 13979 catalog_manager.cc:1259] Loaded cluster ID: ed0b8e4c96324510b4b71044242c7681
I20260811 16:47:51.011265 13979 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:47:51.011468 13979 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:51.011538 13979 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: Loaded TSK: 0
I20260811 16:47:51.011636 13979 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:47:51.071177 13213 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48486:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:47:51.072964 13213 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:51.074112 12938 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [term 2 FOLLOWER]: Refusing update from remote peer 7a2869c141d846539ffe3865d983537f: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260811 16:47:51.074164 13965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.073994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.0.0.1:39250)
0811 16:47:51.074067 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.074137 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 16:47:51.074471 13976 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 16:47:51.074632 13965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.074514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.0.0.1:39264)
0811 16:47:51.074558 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.074590 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 16:47:51.074736 13189 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f -> Peer c15aa67b0c6b4e10bde14c83c174eb6e (127.2.55.190:32981): Couldn't send request to peer c15aa67b0c6b4e10bde14c83c174eb6e. Status: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:47:51.075207 13967 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a2869c141d846539ffe3865d983537f. Latest consensus state: current_term: 2 leader_uuid: "7a2869c141d846539ffe3865d983537f" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } } }
I20260811 16:47:51.075318 13967 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:51.075767 13976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "7a2869c141d846539ffe3865d983537f" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } } }
I20260811 16:47:51.075896 13976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:51.076081 13967 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "7a2869c141d846539ffe3865d983537f" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "c15aa67b0c6b4e10bde14c83c174eb6e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 32981 } } peers { permanent_uuid: "cb276d7b826c4576b9fb093714f25a04" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 45195 } attrs { promote: false } } peers { permanent_uuid: "7a2869c141d846539ffe3865d983537f" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 44659 } attrs { promote: false } } }
I20260811 16:47:51.076174 13967 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb276d7b826c4576b9fb093714f25a04 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:51.081142 13989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.077717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:37995 (local address 127.0.0.1:35418)
0811 16:47:51.078082 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.078091 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:51.078138 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:51.078342 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:51.078343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:51.078345 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:51.078391 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:51.078392 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.079286 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.079287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:51.080064 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:51.080066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.080875 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.080876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:51.080938 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:51.080942 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:51.080990 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 16:47:51.081028 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":223,"thread_start_us":69,"threads_started":1}
I20260811 16:47:51.081346 13965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.077626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:41437 (local address 127.0.0.1:54026)
0811 16:47:51.077686 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.077697 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:51.077742 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:51.078134 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:51.078136 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:51.078139 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:51.078185 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:51.078186 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.079221 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.079222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:51.080285 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:51.080287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.081076 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.081077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:51.081140 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:51.081144 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:51.081223 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 16:47:51.081272 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 16:47:51.081389 13986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.077807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35418 (local address 127.2.55.129:37995)
0811 16:47:51.078134 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:51.078136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:51.078145 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:51.078200 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:51.078201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:51.078213 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:51.078286 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:51.078512 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.079227 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.080189 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.080740 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.080805 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:51.080818 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:51.081252 (+ 434us) server_negotiation.cc:299] Negotiation successful
0811 16:47:51.081310 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":75,"threads_started":1}
I20260811 16:47:51.081430 13988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.077828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54026 (local address 127.2.55.131:41437)
0811 16:47:51.077977 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:51.077979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:51.077988 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:51.078015 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:51.078016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:51.078026 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:51.078250 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:51.078298 (+ 48us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.079138 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.080434 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.080991 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.081076 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:51.081089 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:51.081304 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 16:47:51.081348 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":95,"threads_started":1}
I20260811 16:47:51.081590 13383 tablet_service.cc:1467] Processing CreateTablet for tablet bc180e12108f43bbb627336286b78518 (DEFAULT_TABLE table=test-table [id=588b6cdf21ef4ed6a5befe4a8fd8cd09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:51.081615 13777 tablet_service.cc:1467] Processing CreateTablet for tablet bc180e12108f43bbb627336286b78518 (DEFAULT_TABLE table=test-table [id=588b6cdf21ef4ed6a5befe4a8fd8cd09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:51.081730 13383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc180e12108f43bbb627336286b78518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:51.081743 13777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc180e12108f43bbb627336286b78518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:51.081943 13968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.077717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:46151 (local address 127.0.0.1:43698)
0811 16:47:51.077828 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.077838 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:51.077890 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:51.078058 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:51.078059 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:51.078061 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:51.078124 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:51.078125 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.079023 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.079025 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:51.080210 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:51.080213 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.081220 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.081221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:51.081281 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:51.081286 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:47:51.081318 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 16:47:51.081354 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"mutex_wait_us":1}
I20260811 16:47:51.082432 13987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.077828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43698 (local address 127.2.55.130:46151)
0811 16:47:51.077932 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:51.077935 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:51.077944 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:51.077973 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:51.077973 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:51.077986 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:51.078053 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:51.078306 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.078932 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.080296 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.081095 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.082248 (+ 1153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:51.082266 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:51.082286 (+ 20us) server_negotiation.cc:299] Negotiation successful
0811 16:47:51.082332 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":52,"threads_started":1}
I20260811 16:47:51.082852 13586 tablet_service.cc:1467] Processing CreateTablet for tablet bc180e12108f43bbb627336286b78518 (DEFAULT_TABLE table=test-table [id=588b6cdf21ef4ed6a5befe4a8fd8cd09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:51.082973 13586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc180e12108f43bbb627336286b78518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:51.083441 13991 tablet_bootstrap.cc:492] T bc180e12108f43bbb627336286b78518 P d0d2941eac2a4299b74d9b1469d64c4a: Bootstrap starting.
I20260811 16:47:51.083884 13991 tablet_bootstrap.cc:654] T bc180e12108f43bbb627336286b78518 P d0d2941eac2a4299b74d9b1469d64c4a: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:51.084210 13993 tablet_bootstrap.cc:492] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567: Bootstrap starting.
I20260811 16:47:51.084367 13990 tablet_bootstrap.cc:492] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8: Bootstrap starting.
I20260811 16:47:51.084466 13991 tablet_bootstrap.cc:492] T bc180e12108f43bbb627336286b78518 P d0d2941eac2a4299b74d9b1469d64c4a: No bootstrap required, opened a new log
I20260811 16:47:51.084517 13991 ts_tablet_manager.cc:1397] T bc180e12108f43bbb627336286b78518 P d0d2941eac2a4299b74d9b1469d64c4a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:51.084618 13993 tablet_bootstrap.cc:654] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:51.084645 13991 raft_consensus.cc:348] T bc180e12108f43bbb627336286b78518 P d0d2941eac2a4299b74d9b1469d64c4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } }
I20260811 16:47:51.084753 13991 raft_consensus.cc:374] T bc180e12108f43bbb627336286b78518 P d0d2941eac2a4299b74d9b1469d64c4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:51.084781 13991 raft_consensus.cc:729] T bc180e12108f43bbb627336286b78518 P d0d2941eac2a4299b74d9b1469d64c4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2941eac2a4299b74d9b1469d64c4a, State: Initialized, Role: FOLLOWER
I20260811 16:47:51.084811 13990 tablet_bootstrap.cc:654] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:51.084865 13991 consensus_queue.cc:260] T bc180e12108f43bbb627336286b78518 P d0d2941eac2a4299b74d9b1469d64c4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } }
I20260811 16:47:51.085032 13991 ts_tablet_manager.cc:1428] T bc180e12108f43bbb627336286b78518 P d0d2941eac2a4299b74d9b1469d64c4a: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:51.085259 13993 tablet_bootstrap.cc:492] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567: No bootstrap required, opened a new log
I20260811 16:47:51.085315 13993 ts_tablet_manager.cc:1397] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:51.085456 13993 raft_consensus.cc:348] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } }
I20260811 16:47:51.085548 13993 raft_consensus.cc:374] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:51.085577 13993 raft_consensus.cc:729] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98acc595193142a68059dd161eb1a567, State: Initialized, Role: FOLLOWER
I20260811 16:47:51.085620 13993 consensus_queue.cc:260] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } }
I20260811 16:47:51.085691 13479 heartbeater.cc:503] Master 127.2.55.188:44659 was elected leader, sending a full tablet report...
I20260811 16:47:51.085717 13990 tablet_bootstrap.cc:492] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8: No bootstrap required, opened a new log
I20260811 16:47:51.085765 13990 ts_tablet_manager.cc:1397] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:51.085795 13993 ts_tablet_manager.cc:1428] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:51.085881 13990 raft_consensus.cc:348] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } }
I20260811 16:47:51.085948 13990 raft_consensus.cc:374] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:51.085970 13990 raft_consensus.cc:729] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc3d668aa13846cab5c2bd23cb8a49c8, State: Initialized, Role: FOLLOWER
I20260811 16:47:51.086014 13990 consensus_queue.cc:260] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } }
I20260811 16:47:51.086161 13990 ts_tablet_manager.cc:1428] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:51.086771 14003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.085978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.129:36793)
0811 16:47:51.086690 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.086730 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":686,"thread_start_us":99,"threads_started":1}
I20260811 16:47:51.087181 14009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.086966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.129:44527)
0811 16:47:51.087107 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.087147 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":78,"threads_started":1}
I20260811 16:47:51.087210 14006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.086509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.130:34007)
0811 16:47:51.087126 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.087166 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":77,"threads_started":1}
I20260811 16:47:51.087414 13862 heartbeater.cc:503] Master 127.2.55.188:44659 was elected leader, sending a full tablet report...
I20260811 16:47:51.087538 14007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.086538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.131:59013)
0811 16:47:51.087434 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.087500 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":875,"thread_start_us":84,"threads_started":1}
I20260811 16:47:51.087934 14007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.087814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.131:50185)
0811 16:47:51.087875 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.087905 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 16:47:51.111631 14002 raft_consensus.cc:482] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:51.111730 14002 raft_consensus.cc:504] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } }
I20260811 16:47:51.112196 14002 leader_election.cc:288] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc3d668aa13846cab5c2bd23cb8a49c8 (127.2.55.131:41437), d0d2941eac2a4299b74d9b1469d64c4a (127.2.55.129:37995)
I20260811 16:47:51.115423 14006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.112380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:37995 (local address 127.2.55.130:34011)
0811 16:47:51.112441 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.112454 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:51.112506 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:51.112735 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:51.112736 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:51.112738 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:51.112816 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:51.112818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.113536 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.113537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:51.114608 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:51.114611 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.115146 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.115147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:51.115220 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:51.115225 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:47:51.115308 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 16:47:51.115348 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 16:47:51.115423 13986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.112524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:34011 (local address 127.2.55.129:37995)
0811 16:47:51.112578 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:51.112582 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:51.112611 (+ 29us) server_negotiation.cc:407] Connection header received
0811 16:47:51.112638 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:51.112638 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:51.112650 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:51.112714 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:51.112965 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.113447 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.114699 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.115059 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.115146 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:51.115158 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:51.115320 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 16:47:51.115360 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 16:47:51.115650 14010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.112430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:41437 (local address 127.2.55.130:56087)
0811 16:47:51.112615 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.112626 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:51.112720 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:51.112927 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:51.112928 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:51.112930 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:51.113010 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:51.113012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.113817 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.113818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:51.114747 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:51.114750 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.115343 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.115344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:51.115418 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:51.115421 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:47:51.115489 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 16:47:51.115536 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":128,"threads_started":1}
I20260811 16:47:51.115653 13416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc180e12108f43bbb627336286b78518" candidate_uuid: "98acc595193142a68059dd161eb1a567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" is_pre_election: true
I20260811 16:47:51.115753 13988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.112472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:56087 (local address 127.2.55.131:41437)
0811 16:47:51.112548 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:51.112551 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:51.112704 (+ 153us) server_negotiation.cc:407] Connection header received
0811 16:47:51.112777 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:51.112779 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:51.112792 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:51.112918 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:51.113088 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.113671 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.114845 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.115229 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.115317 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:51.115329 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:51.115626 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 16:47:51.115676 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 16:47:51.115793 13416 raft_consensus.cc:2454] T bc180e12108f43bbb627336286b78518 P d0d2941eac2a4299b74d9b1469d64c4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98acc595193142a68059dd161eb1a567 in term 0.
I20260811 16:47:51.115931 13802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc180e12108f43bbb627336286b78518" candidate_uuid: "98acc595193142a68059dd161eb1a567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" is_pre_election: true
I20260811 16:47:51.116024 13802 raft_consensus.cc:2454] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98acc595193142a68059dd161eb1a567 in term 0.
I20260811 16:47:51.115984 13516 leader_election.cc:302] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98acc595193142a68059dd161eb1a567, d0d2941eac2a4299b74d9b1469d64c4a; no voters:
I20260811 16:47:51.116171 14002 raft_consensus.cc:2781] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:51.116218 14002 raft_consensus.cc:482] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:51.116250 14002 raft_consensus.cc:3037] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:51.117055 14002 raft_consensus.cc:504] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } }
I20260811 16:47:51.117218 14002 leader_election.cc:288] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [CANDIDATE]: Term 1 election: Requested vote from peers fc3d668aa13846cab5c2bd23cb8a49c8 (127.2.55.131:41437), d0d2941eac2a4299b74d9b1469d64c4a (127.2.55.129:37995)
I20260811 16:47:51.117377 13802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc180e12108f43bbb627336286b78518" candidate_uuid: "98acc595193142a68059dd161eb1a567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8"
I20260811 16:47:51.117377 13416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc180e12108f43bbb627336286b78518" candidate_uuid: "98acc595193142a68059dd161eb1a567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2941eac2a4299b74d9b1469d64c4a"
I20260811 16:47:51.117460 13802 raft_consensus.cc:3037] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:51.117460 13416 raft_consensus.cc:3037] T bc180e12108f43bbb627336286b78518 P d0d2941eac2a4299b74d9b1469d64c4a [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:51.118305 13802 raft_consensus.cc:2454] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98acc595193142a68059dd161eb1a567 in term 1.
I20260811 16:47:51.118326 13416 raft_consensus.cc:2454] T bc180e12108f43bbb627336286b78518 P d0d2941eac2a4299b74d9b1469d64c4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98acc595193142a68059dd161eb1a567 in term 1.
I20260811 16:47:51.118605 13517 leader_election.cc:302] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98acc595193142a68059dd161eb1a567, fc3d668aa13846cab5c2bd23cb8a49c8; no voters:
I20260811 16:47:51.118784 14002 raft_consensus.cc:2781] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:51.119091 14002 raft_consensus.cc:686] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [term 1 LEADER]: Becoming Leader. State: Replica: 98acc595193142a68059dd161eb1a567, State: Running, Role: LEADER
I20260811 16:47:51.119207 13680 heartbeater.cc:503] Master 127.2.55.188:44659 was elected leader, sending a full tablet report...
I20260811 16:47:51.119261 14002 consensus_queue.cc:237] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } }
I20260811 16:47:51.119459 14006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.119345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.130:33603)
0811 16:47:51.119399 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.119432 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 16:47:51.120296 13213 catalog_manager.cc:5495] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 reported cstate change: term changed from 0 to 1, leader changed from <none> to 98acc595193142a68059dd161eb1a567 (127.2.55.130). New cstate: current_term: 1 leader_uuid: "98acc595193142a68059dd161eb1a567" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98acc595193142a68059dd161eb1a567" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 46151 } health_report { overall_health: HEALTHY } } }
I20260811 16:47:51.128213 13987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.126066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43714 (local address 127.2.55.130:46151)
0811 16:47:51.126127 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:51.126128 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:51.126136 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:47:51.126165 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:51.126166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:51.126203 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:51.126263 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:51.126366 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.126812 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.127540 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:51.127721 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:51.127771 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:51.127907 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:51.128007 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:51.128062 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:51.128098 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 16:47:51.128116 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:47:51.129374 13802 raft_consensus.cc:1261] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 1 FOLLOWER]: Refusing update from remote peer 98acc595193142a68059dd161eb1a567: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:51.129475 13416 raft_consensus.cc:1261] T bc180e12108f43bbb627336286b78518 P d0d2941eac2a4299b74d9b1469d64c4a [term 1 FOLLOWER]: Refusing update from remote peer 98acc595193142a68059dd161eb1a567: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:51.129666 14002 consensus_queue.cc:1035] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc3d668aa13846cab5c2bd23cb8a49c8" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:51.129801 14011 consensus_queue.cc:1035] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2941eac2a4299b74d9b1469d64c4a" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 37995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:51.130916 14007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.130747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.131:57741)
0811 16:47:51.130844 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.130882 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 16:47:51.131062 14003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.130805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.129:36991)
0811 16:47:51.131002 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.131033 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179}
I20260811 16:47:51.131846 14018 mvcc.cc:205] Tried to move back new op lower bound from 7317368304143577088 to 7317368304105246720. Current Snapshot: MvccSnapshot[applied={T|T < 7317368304143577088}]
I20260811 16:47:51.132035 14006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.131905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.130:41523)
0811 16:47:51.131979 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.132006 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 16:47:51.132346 14003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.132225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.129:60825)
0811 16:47:51.132291 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.132316 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 16:47:51.133350 14007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.133137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:32981 (local address 127.2.55.131:52615)
0811 16:47:51.133291 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.133322 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:32981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
I20260811 16:47:51.134150 13211 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48486:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:51.134238 13211 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48486:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:51.135758 13211 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7a2869c141d846539ffe3865d983537f: Sending DeleteTablet for 3 replicas of tablet bc180e12108f43bbb627336286b78518
I20260811 16:47:51.136050 13586 tablet_service.cc:1514] Processing DeleteTablet for tablet bc180e12108f43bbb627336286b78518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:51 UTC) from {username='oryx', principal='oryx/127.2.55.188@KRBTEST.COM'} at 127.0.0.1:43698
I20260811 16:47:51.136143 13777 tablet_service.cc:1514] Processing DeleteTablet for tablet bc180e12108f43bbb627336286b78518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:51 UTC) from {username='oryx', principal='oryx/127.2.55.188@KRBTEST.COM'} at 127.0.0.1:54026
I20260811 16:47:51.136224 13383 tablet_service.cc:1514] Processing DeleteTablet for tablet bc180e12108f43bbb627336286b78518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:51 UTC) from {username='oryx', principal='oryx/127.2.55.188@KRBTEST.COM'} at 127.0.0.1:35418
I20260811 16:47:51.136385 14029 tablet_replica.cc:330] T bc180e12108f43bbb627336286b78518 P d0d2941eac2a4299b74d9b1469d64c4a: stopping tablet replica
I20260811 16:47:51.136436 14029 raft_consensus.cc:2229] T bc180e12108f43bbb627336286b78518 P d0d2941eac2a4299b74d9b1469d64c4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:51.136477 14029 raft_consensus.cc:2258] T bc180e12108f43bbb627336286b78518 P d0d2941eac2a4299b74d9b1469d64c4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:51.136613 14027 tablet_replica.cc:330] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567: stopping tablet replica
I20260811 16:47:51.136618 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 13151
I20260811 16:47:51.139457 14028 tablet_replica.cc:330] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8: stopping tablet replica
I20260811 16:47:51.139535 14028 raft_consensus.cc:2229] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:51.139587 14028 raft_consensus.cc:2258] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:51.136664 14027 raft_consensus.cc:2229] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:47:51.139758 14027 raft_consensus.cc:2258] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:51.140134 14027 ts_tablet_manager.cc:1905] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:51.143029 14027 ts_tablet_manager.cc:1918] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:51.143090 14027 log.cc:1196] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/bc180e12108f43bbb627336286b78518
I20260811 16:47:51.143334 14027 ts_tablet_manager.cc:1939] T bc180e12108f43bbb627336286b78518 P 98acc595193142a68059dd161eb1a567: Deleting consensus metadata
I20260811 16:47:51.143759 14028 ts_tablet_manager.cc:1905] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:51.143760 13191 catalog_manager.cc:4841] TS 98acc595193142a68059dd161eb1a567 (127.2.55.130:46151): tablet bc180e12108f43bbb627336286b78518 (table test-table [id=588b6cdf21ef4ed6a5befe4a8fd8cd09]) successfully deleted
I20260811 16:47:51.145715 14028 ts_tablet_manager.cc:1918] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:51.145792 14028 log.cc:1196] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/bc180e12108f43bbb627336286b78518
I20260811 16:47:51.146031 14028 ts_tablet_manager.cc:1939] T bc180e12108f43bbb627336286b78518 P fc3d668aa13846cab5c2bd23cb8a49c8: Deleting consensus metadata
I20260811 16:47:51.146677 13188 catalog_manager.cc:4841] TS fc3d668aa13846cab5c2bd23cb8a49c8 (127.2.55.131:41437): tablet bc180e12108f43bbb627336286b78518 (table test-table [id=588b6cdf21ef4ed6a5befe4a8fd8cd09]) successfully deleted
I20260811 16:47:51.150894 13968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:51.150763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:37995 (local address 127.0.0.1:35428)
0811 16:47:51.150823 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:51.150854 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:37995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 16:47:51.151016 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 13492
W20260811 16:47:51.151075 13187 catalog_manager.cc:4584] TS d0d2941eac2a4299b74d9b1469d64c4a (127.2.55.129:37995): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bc180e12108f43bbb627336286b78518: Network error: Client connection negotiation failed: client connection to 127.2.55.129:37995: connect: Connection refused (error 111)
I20260811 16:47:51.161756 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 13690
I20260811 16:47:51.175141 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 12731
I20260811 16:47:51.189057 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 13016
2026-08-11T16:47:51Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5236 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:47:51 dist-test-slave-3h5h krb5kdc[14034](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:47:51 dist-test-slave-3h5h krb5kdc[14034](info): set up 2 sockets
Aug 11 16:47:51 dist-test-slave-3h5h krb5kdc[14034](info): commencing operation
krb5kdc: starting...
W20260811 16:47:52.495885 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.276s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:47:52 dist-test-slave-3h5h krb5kdc[14034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466872, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:47:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:52Z Disabled control of system clock
WARNING: no policy specified for oryx/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.190.keytab.
Entry for principal oryx/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.190.keytab.
I20260811 16:47:52.628328 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:43637
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.190.keytab
--principal=oryx/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:43637
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:52.711934 14053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:52.712144 14053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:52.712168 14053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:52.713261 14053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:52.713297 14053 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 16:47:52.713310 14053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:52.713323 14053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:52.713336 14053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:52.713348 14053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:52.714795 14053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:43637
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.190.keytab
--principal=oryx/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:43637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:52.714983 14053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:52.715150 14053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:52.720041 14061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:52.720041 14067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:52.720041 14063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:52.720290 14053 server_base.cc:1034] running on GCE node
I20260811 16:47:52.720624 14053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:52.720978 14053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:52.722139 14053 hybrid_clock.cc:648] HybridClock initialized: now 1786466872722162 us; error 63 us; skew 500 ppm
Aug 11 16:47:52 dist-test-slave-3h5h krb5kdc[14034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466872, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:52.724647 14053 init.cc:377] Logged in from keytab as oryx/127.2.55.190@KRBTEST.COM (short username oryx)
I20260811 16:47:52.725206 14053 webserver.cc:460] Webserver started at http://127.2.55.190:43963/ using document root <none> and password file <none>
I20260811 16:47:52.725438 14053 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:52.725507 14053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:52.725664 14053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:52.726775 14053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "5ecfa2fe66dd444e92a90a89450691e1"
format_stamp: "Formatted at 2026-08-11 16:47:52 on dist-test-slave-3h5h"
server_key: "14f3c4886ecef36881ec9d17178be4c9"
server_key_iv: "10638449e0fd28fb5d1f6ed9b6daf809"
server_key_version: "encryptionkey@0"
I20260811 16:47:52.727151 14053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "5ecfa2fe66dd444e92a90a89450691e1"
format_stamp: "Formatted at 2026-08-11 16:47:52 on dist-test-slave-3h5h"
server_key: "14f3c4886ecef36881ec9d17178be4c9"
server_key_iv: "10638449e0fd28fb5d1f6ed9b6daf809"
server_key_version: "encryptionkey@0"
I20260811 16:47:52.728490 14053 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:47:52.729326 14084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:52.729503 14053 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:52.729606 14053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "5ecfa2fe66dd444e92a90a89450691e1"
format_stamp: "Formatted at 2026-08-11 16:47:52 on dist-test-slave-3h5h"
server_key: "14f3c4886ecef36881ec9d17178be4c9"
server_key_iv: "10638449e0fd28fb5d1f6ed9b6daf809"
server_key_version: "encryptionkey@0"
I20260811 16:47:52.729712 14053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:52.755609 14053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:52.757932 14053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:52.758116 14053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:52.763337 14053 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:43637
I20260811 16:47:52.763392 14168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:43637 every 8 connection(s)
I20260811 16:47:52.763746 14053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:52.764397 14169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:52.766750 14169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1: Bootstrap starting.
I20260811 16:47:52.767467 14169 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:52.767783 14169 log.cc:824] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:52.768476 14169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1: No bootstrap required, opened a new log
I20260811 16:47:52.770673 14169 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ecfa2fe66dd444e92a90a89450691e1" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43637 } }
I20260811 16:47:52.770812 14169 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:52.770835 14169 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ecfa2fe66dd444e92a90a89450691e1, State: Initialized, Role: FOLLOWER
I20260811 16:47:52.770987 14169 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ecfa2fe66dd444e92a90a89450691e1" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43637 } }
I20260811 16:47:52.771063 14169 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:52.771108 14169 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:52.771162 14169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:52.771694 14169 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ecfa2fe66dd444e92a90a89450691e1" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43637 } }
I20260811 16:47:52.771811 14169 leader_election.cc:302] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ecfa2fe66dd444e92a90a89450691e1; no voters:
I20260811 16:47:52.772012 14169 leader_election.cc:288] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:52.772089 14172 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:52.772312 14169 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:52.772359 14172 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [term 1 LEADER]: Becoming Leader. State: Replica: 5ecfa2fe66dd444e92a90a89450691e1, State: Running, Role: LEADER
I20260811 16:47:52.772475 14172 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ecfa2fe66dd444e92a90a89450691e1" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43637 } }
I20260811 16:47:52.772912 14177 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ecfa2fe66dd444e92a90a89450691e1. Latest consensus state: current_term: 1 leader_uuid: "5ecfa2fe66dd444e92a90a89450691e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ecfa2fe66dd444e92a90a89450691e1" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43637 } } }
I20260811 16:47:52.772996 14177 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:52.773000 14174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ecfa2fe66dd444e92a90a89450691e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ecfa2fe66dd444e92a90a89450691e1" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 43637 } } }
I20260811 16:47:52.773334 14174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:52.773411 14185 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:52.773875 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 14053
I20260811 16:47:52.773976 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:52.773999 14185 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:52.774212 2270 external_mini_cluster.cc:1428] Setting key 3ed9eea244e4d942abc6b73d3da1cee3
I20260811 16:47:52.775700 14185 catalog_manager.cc:1347] Generated new cluster ID: 8f26cb74f6904b1fa064628356851a91
I20260811 16:47:52.775759 14185 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:47:52 dist-test-slave-3h5h krb5kdc[14034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466872, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM
I20260811 16:47:52.787099 14202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:52.774695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57062 (local address 127.2.55.190:43637)
0811 16:47:52.775131 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:52.775141 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:52.777850 (+ 2709us) server_negotiation.cc:407] Connection header received
0811 16:47:52.778018 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:52.778027 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:52.778087 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:52.778265 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:52.778906 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:52.779872 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:52.780635 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:52.781168 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:52.781291 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:52.783678 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:52.783682 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:52.783683 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:52.783702 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:52.785450 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:52.785847 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:52.785851 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:52.785851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:52.785947 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:52.786166 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:52.786167 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:52.786168 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:52.786416 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:52.786589 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:52.786686 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 16:47:52.786837 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":80,"threads_started":1}
I20260811 16:47:52.788729 14185 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:52.789435 14185 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:52.800321 14185 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1: Generated new TSK 0
I20260811 16:47:52.800556 14185 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.129.keytab.
Entry for principal oryx/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.129.keytab.
I20260811 16:47:52.836572 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:43637
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.129.keytab
--principal=oryx/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:52.924175 14210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:52.924382 14210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:52.924407 14210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:52.925580 14210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:52.925624 14210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:52.925645 14210 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:47:52.925663 14210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:47:52.927170 14210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.129.keytab
--principal=oryx/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.55.190:43637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:52.927374 14210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:52.927559 14210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:52.932884 14218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:52.932965 14210 server_base.cc:1034] running on GCE node
W20260811 16:47:52.932891 14224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:52.932876 14221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:52.933353 14210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:52.933605 14210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:52.934751 14210 hybrid_clock.cc:648] HybridClock initialized: now 1786466872934740 us; error 31 us; skew 500 ppm
Aug 11 16:47:52 dist-test-slave-3h5h krb5kdc[14034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466872, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:52.937346 14210 init.cc:377] Logged in from keytab as oryx/127.2.55.129@KRBTEST.COM (short username oryx)
I20260811 16:47:52.937848 14210 webserver.cc:460] Webserver started at http://127.2.55.129:44083/ using document root <none> and password file <none>
I20260811 16:47:52.938115 14210 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:52.938187 14210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:52.938339 14210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:52.939465 14210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "615e81324be24310b2c3711e7593ef65"
format_stamp: "Formatted at 2026-08-11 16:47:52 on dist-test-slave-3h5h"
server_key: "7240bbabf1fb6f125eadcbf84d37be4e"
server_key_iv: "92dd57ca05fda4a187c4186f1cafaf9a"
server_key_version: "encryptionkey@0"
I20260811 16:47:52.939852 14210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "615e81324be24310b2c3711e7593ef65"
format_stamp: "Formatted at 2026-08-11 16:47:52 on dist-test-slave-3h5h"
server_key: "7240bbabf1fb6f125eadcbf84d37be4e"
server_key_iv: "92dd57ca05fda4a187c4186f1cafaf9a"
server_key_version: "encryptionkey@0"
I20260811 16:47:52.941335 14210 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260811 16:47:52.942211 14237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:52.942436 14210 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:52.942552 14210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "615e81324be24310b2c3711e7593ef65"
format_stamp: "Formatted at 2026-08-11 16:47:52 on dist-test-slave-3h5h"
server_key: "7240bbabf1fb6f125eadcbf84d37be4e"
server_key_iv: "92dd57ca05fda4a187c4186f1cafaf9a"
server_key_version: "encryptionkey@0"
I20260811 16:47:52.942652 14210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:52.955251 14210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:52.957695 14210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:52.957886 14210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:52.958518 14210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:52.958585 14210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:52.958642 14210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:52.958668 14210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:52.966373 14210 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:45087
I20260811 16:47:52.966452 14400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:45087 every 8 connection(s)
I20260811 16:47:52.966835 14210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:47:52 dist-test-slave-3h5h krb5kdc[14034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466872, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM
I20260811 16:47:52.970432 14202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:52.959204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:51213 (local address 127.2.55.190:43637)
0811 16:47:52.959297 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:52.959300 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:52.959586 (+ 286us) server_negotiation.cc:407] Connection header received
0811 16:47:52.960354 (+ 768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:52.960356 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:52.960373 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:52.960463 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:52.961564 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:52.962157 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:52.963956 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:52.964213 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:52.964276 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:52.967572 (+ 3296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:52.967574 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:52.967574 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:52.967585 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:52.969085 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:52.969497 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:52.969498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:52.969498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:52.969551 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:52.969831 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:52.969831 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:52.969831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:52.969943 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:52.969994 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:52.970289 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 16:47:52.970364 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 16:47:52.970616 14248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:52.959180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:43637 (local address 127.2.55.129:51213)
0811 16:47:52.959385 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:52.959436 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:52.960240 (+ 804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:52.960601 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:52.960608 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:52.961079 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:52.961419 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:52.961427 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:52.962281 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:52.962282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:52.963840 (+ 1558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:52.963844 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:52.964309 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:52.964311 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:52.964478 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:52.965371 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:52.965384 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:52.967449 (+ 2065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:52.969167 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:52.969181 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:52.969183 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:52.969424 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:52.969625 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:52.969626 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:52.969626 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:52.969758 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:52.970014 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:52.970021 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:52.970150 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 16:47:52.970260 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 16:47:52.970396 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":100,"threads_started":1}
I20260811 16:47:52.971242 14401 heartbeater.cc:347] Connected to a master server at 127.2.55.190:43637
I20260811 16:47:52.971331 14401 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:52.971534 14401 heartbeater.cc:511] Master 127.2.55.190:43637 requested a full tablet report, sending...
I20260811 16:47:52.972142 14108 ts_manager.cc:194] Registered new tserver with Master: 615e81324be24310b2c3711e7593ef65 (127.2.55.129:45087)
I20260811 16:47:52.972769 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 14210
I20260811 16:47:52.972893 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:47:52.973104 2270 external_mini_cluster.cc:1428] Setting key 586a9181dbd145387487e1d2671d9464
I20260811 16:47:52.973208 14108 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:51213
I20260811 16:47:52.979041 14202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:52.972524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:60085 (local address 127.2.55.190:43637)
0811 16:47:52.972571 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:52.972573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:52.972697 (+ 124us) server_negotiation.cc:407] Connection header received
0811 16:47:52.972778 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:52.972779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:52.972790 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:52.972862 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:52.973358 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:52.973972 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:52.974745 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:52.975057 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:52.975135 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:52.976296 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:52.976298 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:52.976298 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:52.976304 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:52.977802 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:52.978245 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:52.978247 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:52.978247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:52.978300 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:52.978526 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:52.978527 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:52.978527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:52.978675 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:52.978732 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:52.978914 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 16:47:52.978977 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:47:52.979212 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:52.972447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:43637 (local address 127.2.55.129:60085)
0811 16:47:52.972612 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:52.972623 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:52.972714 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:52.972907 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:52.972908 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:52.973149 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:52.973236 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:52.973238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:52.974097 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:52.974098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:52.974653 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:52.974656 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:52.975139 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:52.975139 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:52.975209 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:52.975738 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:52.975746 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:52.976204 (+ 458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:52.977890 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:52.977892 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:52.977892 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:52.978151 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:52.978369 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:52.978370 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:52.978370 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:52.978449 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:52.978750 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:52.978751 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:52.978811 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 16:47:52.978896 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 16:47:52.979015 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":71,"threads_started":1}
WARNING: no policy specified for oryx/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.130.keytab.
Entry for principal oryx/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.130.keytab.
I20260811 16:47:53.005532 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:43637
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.130.keytab
--principal=oryx/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:53.097060 14418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:53.097268 14418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:53.097292 14418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:53.098446 14418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:53.098483 14418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:53.098505 14418 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:47:53.098521 14418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:47:53.099974 14418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.130.keytab
--principal=oryx/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.55.190:43637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:53.100163 14418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:53.100346 14418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:53.105707 14424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:53.105754 14426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:53.105719 14423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:53.105836 14418 server_base.cc:1034] running on GCE node
I20260811 16:47:53.106156 14418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:53.106393 14418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:53.107532 14418 hybrid_clock.cc:648] HybridClock initialized: now 1786466873107512 us; error 29 us; skew 500 ppm
Aug 11 16:47:53 dist-test-slave-3h5h krb5kdc[14034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466873, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:53.110267 14418 init.cc:377] Logged in from keytab as oryx/127.2.55.130@KRBTEST.COM (short username oryx)
I20260811 16:47:53.110767 14418 webserver.cc:460] Webserver started at http://127.2.55.130:45613/ using document root <none> and password file <none>
I20260811 16:47:53.111009 14418 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:53.111080 14418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:53.111245 14418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:53.112378 14418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "713daa5fce304e848d342075f892955f"
format_stamp: "Formatted at 2026-08-11 16:47:53 on dist-test-slave-3h5h"
server_key: "da6d41981b42b6730a6fcc286a4f2f58"
server_key_iv: "04e12a1fc87cb1a16cda79e94f5a356d"
server_key_version: "encryptionkey@0"
I20260811 16:47:53.112749 14418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "713daa5fce304e848d342075f892955f"
format_stamp: "Formatted at 2026-08-11 16:47:53 on dist-test-slave-3h5h"
server_key: "da6d41981b42b6730a6fcc286a4f2f58"
server_key_iv: "04e12a1fc87cb1a16cda79e94f5a356d"
server_key_version: "encryptionkey@0"
I20260811 16:47:53.114305 14418 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:53.115069 14437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:53.115306 14418 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:53.115417 14418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "713daa5fce304e848d342075f892955f"
format_stamp: "Formatted at 2026-08-11 16:47:53 on dist-test-slave-3h5h"
server_key: "da6d41981b42b6730a6fcc286a4f2f58"
server_key_iv: "04e12a1fc87cb1a16cda79e94f5a356d"
server_key_version: "encryptionkey@0"
I20260811 16:47:53.115494 14418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:53.131210 14418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:53.133842 14418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:53.134013 14418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:53.134665 14418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:53.134716 14418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:53.134754 14418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:53.134778 14418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:47:53 dist-test-slave-3h5h krb5kdc[14034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466873, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM
I20260811 16:47:53.142472 14418 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:44571
I20260811 16:47:53.142560 14605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:44571 every 8 connection(s)
I20260811 16:47:53.142880 14418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:47:53.145862 14202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.135310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:53101 (local address 127.2.55.190:43637)
0811 16:47:53.135387 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:53.135390 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:53.135684 (+ 294us) server_negotiation.cc:407] Connection header received
0811 16:47:53.136243 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:53.136244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:53.136258 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:53.136355 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:53.137371 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.138058 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.139321 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.139539 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.139604 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.142368 (+ 2764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:53.142370 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:53.142370 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:53.142381 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:53.144116 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:53.144643 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:53.144644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:53.144645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:53.144722 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:53.145106 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:53.145107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:53.145107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:53.145245 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:53.145313 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:53.145714 (+ 401us) server_negotiation.cc:299] Negotiation successful
0811 16:47:53.145795 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 16:47:53.146016 14454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.135299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:43637 (local address 127.2.55.130:53101)
0811 16:47:53.135513 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:53.135559 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:53.136133 (+ 574us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:53.136498 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:53.136509 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:53.137022 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:53.137240 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.137245 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.138231 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.138232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.139159 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.139162 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.139627 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.139629 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.139824 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.140484 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:53.140505 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:53.142260 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:53.144242 (+ 1982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:53.144250 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:53.144253 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:53.144529 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:53.144824 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:53.144825 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:53.144826 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:53.144996 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:53.145340 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:53.145347 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:53.145567 (+ 220us) client_negotiation.cc:769] Sending connection context
0811 16:47:53.145664 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 16:47:53.145800 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":124,"threads_started":1}
I20260811 16:47:53.146543 14607 heartbeater.cc:347] Connected to a master server at 127.2.55.190:43637
I20260811 16:47:53.146636 14607 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:53.146831 14607 heartbeater.cc:511] Master 127.2.55.190:43637 requested a full tablet report, sending...
I20260811 16:47:53.147239 14106 ts_manager.cc:194] Registered new tserver with Master: 713daa5fce304e848d342075f892955f (127.2.55.130:44571)
I20260811 16:47:53.147773 14106 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:53101
I20260811 16:47:53.152547 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 14418
I20260811 16:47:53.152690 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:47:53.152961 2270 external_mini_cluster.cc:1428] Setting key f0476bb231689c592045e60240650572
I20260811 16:47:53.153584 14202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.147723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:50235 (local address 127.2.55.190:43637)
0811 16:47:53.147767 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:53.147769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:53.147890 (+ 121us) server_negotiation.cc:407] Connection header received
0811 16:47:53.147912 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:53.147913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:53.147924 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:53.147976 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:53.148340 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.148824 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.149561 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.149779 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.149866 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.150821 (+ 955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:53.150822 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:53.150823 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:53.150830 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:53.152250 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:53.152613 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:53.152614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:53.152615 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:53.152671 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:53.152938 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:53.152939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:53.152940 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:53.153158 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:53.153239 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:53.153408 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 16:47:53.153495 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:47:53.153597 14617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.147630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:43637 (local address 127.2.55.130:50235)
0811 16:47:53.147772 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:53.147785 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:53.147854 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:53.147999 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:53.148001 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:53.148190 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:53.148259 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.148261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.148951 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.148952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.149474 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.149476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.149869 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.149870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.149942 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.150408 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:53.150414 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:53.150710 (+ 296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:53.152355 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:53.152356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:53.152357 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:53.152535 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:53.152754 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:53.152755 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:53.152755 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:53.152823 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:53.153244 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:53.153245 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:53.153294 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 16:47:53.153381 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 16:47:53.153490 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":89,"threads_started":1}
WARNING: no policy specified for oryx/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.131.keytab.
Entry for principal oryx/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.131.keytab.
I20260811 16:47:53.184223 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:43637
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.131.keytab
--principal=oryx/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:53.270787 14623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:53.271005 14623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:53.271030 14623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:53.272362 14623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:53.272403 14623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:53.272423 14623 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:47:53.272440 14623 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:47:53.274147 14623 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.131.keytab
--principal=oryx/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.55.190:43637
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:53.274420 14623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:53.274663 14623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:53.280046 14636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:53.279994 14633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:53.279994 14631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:53.280102 14623 server_base.cc:1034] running on GCE node
I20260811 16:47:53.280439 14623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:53.280644 14623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:53.281781 14623 hybrid_clock.cc:648] HybridClock initialized: now 1786466873281755 us; error 51 us; skew 500 ppm
Aug 11 16:47:53 dist-test-slave-3h5h krb5kdc[14034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466873, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:53.284404 14623 init.cc:377] Logged in from keytab as oryx/127.2.55.131@KRBTEST.COM (short username oryx)
I20260811 16:47:53.284940 14623 webserver.cc:460] Webserver started at http://127.2.55.131:38545/ using document root <none> and password file <none>
I20260811 16:47:53.285172 14623 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:53.285218 14623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:53.285310 14623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:53.286330 14623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "d1462d70f0084118a395abca36729fc4"
format_stamp: "Formatted at 2026-08-11 16:47:53 on dist-test-slave-3h5h"
server_key: "03a051ca0b6fdfe2aeb5b03ce16f9b0e"
server_key_iv: "5cc77d860eddc22b5bb36b01f0ef1c69"
server_key_version: "encryptionkey@0"
I20260811 16:47:53.286639 14623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "d1462d70f0084118a395abca36729fc4"
format_stamp: "Formatted at 2026-08-11 16:47:53 on dist-test-slave-3h5h"
server_key: "03a051ca0b6fdfe2aeb5b03ce16f9b0e"
server_key_iv: "5cc77d860eddc22b5bb36b01f0ef1c69"
server_key_version: "encryptionkey@0"
I20260811 16:47:53.287984 14623 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:47:53.288707 14645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:53.288898 14623 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:53.288980 14623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "d1462d70f0084118a395abca36729fc4"
format_stamp: "Formatted at 2026-08-11 16:47:53 on dist-test-slave-3h5h"
server_key: "03a051ca0b6fdfe2aeb5b03ce16f9b0e"
server_key_iv: "5cc77d860eddc22b5bb36b01f0ef1c69"
server_key_version: "encryptionkey@0"
I20260811 16:47:53.289036 14623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:53.312474 14623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:53.315196 14623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:53.315330 14623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:53.315912 14623 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:53.315963 14623 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:53.315987 14623 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:53.316032 14623 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:47:53 dist-test-slave-3h5h krb5kdc[14034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466873, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM
I20260811 16:47:53.324582 14623 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:35077
I20260811 16:47:53.324632 14823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:35077 every 8 connection(s)
I20260811 16:47:53.325091 14623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:47:53.328256 14202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.316495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:50209 (local address 127.2.55.190:43637)
0811 16:47:53.316578 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:53.316581 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:53.316872 (+ 291us) server_negotiation.cc:407] Connection header received
0811 16:47:53.317736 (+ 864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:53.317737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:53.317749 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:53.317798 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:53.318900 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.319606 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.321537 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.321862 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.321940 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.325081 (+ 3141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:53.325083 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:53.325083 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:53.325092 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:53.326778 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:53.327230 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:53.327231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:53.327231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:53.327300 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:53.327566 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:53.327567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:53.327568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:53.327703 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:53.327776 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:53.328073 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 16:47:53.328161 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 16:47:53.328457 14657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.316441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:43637 (local address 127.2.55.131:50209)
0811 16:47:53.316683 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:53.316743 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:53.317609 (+ 866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:53.317899 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:53.317905 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:53.318418 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:53.318779 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.318787 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.319688 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.319690 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.321433 (+ 1743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.321438 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.321997 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.321998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.322193 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.322772 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:53.322793 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:53.324977 (+ 2184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:53.326889 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:53.326897 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:53.326899 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:53.327140 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:53.327376 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:53.327376 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:53.327377 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:53.327492 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:53.327780 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:53.327787 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:53.327928 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 16:47:53.328034 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 16:47:53.328220 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":126,"threads_started":1}
I20260811 16:47:53.329089 14824 heartbeater.cc:347] Connected to a master server at 127.2.55.190:43637
I20260811 16:47:53.329195 14824 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:53.329433 14824 heartbeater.cc:511] Master 127.2.55.190:43637 requested a full tablet report, sending...
I20260811 16:47:53.329892 14108 ts_manager.cc:194] Registered new tserver with Master: d1462d70f0084118a395abca36729fc4 (127.2.55.131:35077)
I20260811 16:47:53.330490 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 14623
I20260811 16:47:53.330506 14108 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:50209
I20260811 16:47:53.330595 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:47:53.330814 2270 external_mini_cluster.cc:1428] Setting key 298a7be02145f5c8849f9a16cb45b124
I20260811 16:47:53.332532 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:47:53.337128 14202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.330637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:39807 (local address 127.2.55.190:43637)
0811 16:47:53.330676 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:53.330679 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:53.330940 (+ 261us) server_negotiation.cc:407] Connection header received
0811 16:47:53.331009 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:53.331010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:53.331022 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:53.331079 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:53.331459 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.332146 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.333083 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.333377 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.333454 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.334458 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:53.334460 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:53.334460 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:53.334468 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:53.335945 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:53.336354 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:53.336355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:53.336355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:53.336408 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:53.336643 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:53.336644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:53.336644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:53.336758 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:53.336811 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:53.336995 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 16:47:53.337056 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:47:53.337245 14834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.330666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:43637 (local address 127.2.55.131:39807)
0811 16:47:53.330850 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:53.330861 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:53.330952 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:53.331083 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:53.331084 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:53.331316 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:53.331378 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.331379 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.332285 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.332286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.333000 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.333004 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.333474 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.333475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.333581 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.334081 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:53.334087 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:53.334367 (+ 280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:53.336029 (+ 1662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:53.336030 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:53.336030 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:53.336274 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:53.336478 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:53.336478 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:53.336479 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:53.336552 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:53.336824 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:53.336825 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:53.336903 (+ 78us) client_negotiation.cc:769] Sending connection context
0811 16:47:53.336977 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 16:47:53.337094 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":123,"threads_started":1}
Aug 11 16:47:53 dist-test-slave-3h5h krb5kdc[14034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466873, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 16:47:53 dist-test-slave-3h5h krb5kdc[14034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:47:53 dist-test-slave-3h5h krb5kdc[14034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 16:47:53.356974 14202 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:53.351002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57068 (local address 127.2.55.190:43637)
0811 16:47:53.351075 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:53.351077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:53.351086 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:53.351119 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:53.351120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:53.351132 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:53.351186 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:53.351764 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.352261 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.353129 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.353315 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.353374 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.356881 (+ 3507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57068: BlockingRecv error: recv got EOF from 127.0.0.1:57068 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 16:47:53 dist-test-slave-3h5h krb5kdc[14034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466873, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM
I20260811 16:47:53.365566 14202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.357821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57074 (local address 127.2.55.190:43637)
0811 16:47:53.357885 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:53.357887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:53.357953 (+ 66us) server_negotiation.cc:407] Connection header received
0811 16:47:53.357997 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:53.357998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:53.358006 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:53.358064 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:53.358548 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.359019 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.359730 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.360031 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.360147 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.362651 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:53.362653 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:53.362653 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:53.362668 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:53.364094 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:53.364569 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:53.364570 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:53.364571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:53.364637 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:53.364880 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:53.364882 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:53.364882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:53.365076 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:53.365201 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:53.365353 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 16:47:53.365449 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:47:53.367215 14108 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57074:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:47:53.368954 14108 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:53.376869 14865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.371968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47900 (local address 127.2.55.129:45087)
0811 16:47:53.372422 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:53.372427 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:53.372440 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:47:53.372485 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:53.372487 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:53.372515 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:53.372606 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:53.372796 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.374074 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.375593 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.376341 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.376426 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.376508 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:53.376688 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 16:47:53.376727 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":104,"threads_started":1}
I20260811 16:47:53.377128 14863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.371931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44922 (local address 127.2.55.131:35077)
0811 16:47:53.372577 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:53.372580 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:53.372591 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:47:53.372632 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:53.372634 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:53.372650 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:53.372730 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:53.372954 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.374233 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.375668 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.376354 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.376449 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.376539 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:53.376919 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 16:47:53.376973 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":112,"threads_started":1}
I20260811 16:47:53.377333 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.372190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46470 (local address 127.2.55.130:44571)
0811 16:47:53.372481 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:53.372486 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:53.373004 (+ 518us) server_negotiation.cc:407] Connection header received
0811 16:47:53.373048 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:53.373050 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:53.373065 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:53.373153 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:53.373329 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.374391 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.375656 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.376377 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.376435 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.376509 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:53.377156 (+ 647us) server_negotiation.cc:299] Negotiation successful
0811 16:47:53.377221 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":95,"threads_started":1}
I20260811 16:47:53.376838 14864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.372002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:44571 (local address 127.0.0.1:46470)
0811 16:47:53.372887 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:53.372897 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:53.372949 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:53.373171 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:53.373172 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:53.373175 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:53.373224 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.373226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.374478 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.374478 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.375574 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.375576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.376544 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.376545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.376615 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.376619 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:53.376690 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 16:47:53.376734 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":811,"mutex_wait_us":33,"thread_start_us":67,"threads_started":1}
I20260811 16:47:53.376842 14861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.371785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:35077 (local address 127.0.0.1:44922)
0811 16:47:53.372185 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:53.372246 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:53.372312 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:53.372728 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:53.372729 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:53.372731 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:53.372822 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.372824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.374353 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.374354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.375562 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.375565 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.376581 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.376582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.376651 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.376656 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:47:53.376708 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 16:47:53.376747 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":55,"threads_started":1}
I20260811 16:47:53.376863 14862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.371794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:45087 (local address 127.0.0.1:47900)
0811 16:47:53.372239 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:53.372252 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:53.372314 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:53.372618 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:53.372622 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:53.372625 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:53.372702 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.372704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.374172 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.374173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.375493 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.375496 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.376440 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.376441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.376558 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.376577 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 16:47:53.376658 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 16:47:53.376724 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":92,"threads_started":1}
I20260811 16:47:53.378175 14507 tablet_service.cc:1467] Processing CreateTablet for tablet 7ad6bf28f7c64c33b40e2ee31194b54a (DEFAULT_TABLE table=test-table [id=9e591095d29942039892d9d884479c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:53.378193 14723 tablet_service.cc:1467] Processing CreateTablet for tablet 7ad6bf28f7c64c33b40e2ee31194b54a (DEFAULT_TABLE table=test-table [id=9e591095d29942039892d9d884479c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:53.378248 14307 tablet_service.cc:1467] Processing CreateTablet for tablet 7ad6bf28f7c64c33b40e2ee31194b54a (DEFAULT_TABLE table=test-table [id=9e591095d29942039892d9d884479c05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:53.378578 14507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ad6bf28f7c64c33b40e2ee31194b54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:53.378578 14307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ad6bf28f7c64c33b40e2ee31194b54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:53.378578 14723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ad6bf28f7c64c33b40e2ee31194b54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:53.382138 14867 tablet_bootstrap.cc:492] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f: Bootstrap starting.
I20260811 16:47:53.382539 14868 tablet_bootstrap.cc:492] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4: Bootstrap starting.
I20260811 16:47:53.382998 14867 tablet_bootstrap.cc:654] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:53.383134 14868 tablet_bootstrap.cc:654] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:53.383380 14867 log.cc:824] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:53.383420 14868 log.cc:824] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:53.383780 14870 tablet_bootstrap.cc:492] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65: Bootstrap starting.
I20260811 16:47:53.384260 14867 tablet_bootstrap.cc:492] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f: No bootstrap required, opened a new log
I20260811 16:47:53.384300 14870 tablet_bootstrap.cc:654] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:53.384356 14867 ts_tablet_manager.cc:1397] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:47:53.384593 14870 log.cc:824] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:53.385146 14868 tablet_bootstrap.cc:492] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4: No bootstrap required, opened a new log
I20260811 16:47:53.385221 14868 ts_tablet_manager.cc:1397] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 16:47:53.385447 14870 tablet_bootstrap.cc:492] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65: No bootstrap required, opened a new log
I20260811 16:47:53.385516 14870 ts_tablet_manager.cc:1397] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:47:53.386557 14867 raft_consensus.cc:348] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:53.386727 14867 raft_consensus.cc:374] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:53.386776 14867 raft_consensus.cc:729] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 713daa5fce304e848d342075f892955f, State: Initialized, Role: FOLLOWER
I20260811 16:47:53.386927 14867 consensus_queue.cc:260] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:53.387255 14867 ts_tablet_manager.cc:1428] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:47:53.387286 14607 heartbeater.cc:503] Master 127.2.55.190:43637 was elected leader, sending a full tablet report...
I20260811 16:47:53.387210 14868 raft_consensus.cc:348] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:53.387357 14868 raft_consensus.cc:374] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:53.387387 14868 raft_consensus.cc:729] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1462d70f0084118a395abca36729fc4, State: Initialized, Role: FOLLOWER
I20260811 16:47:53.387586 14870 raft_consensus.cc:348] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:53.387497 14868 consensus_queue.cc:260] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:53.387753 14870 raft_consensus.cc:374] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:53.387804 14870 raft_consensus.cc:729] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 615e81324be24310b2c3711e7593ef65, State: Initialized, Role: FOLLOWER
I20260811 16:47:53.387944 14868 ts_tablet_manager.cc:1428] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 16:47:53.387938 14870 consensus_queue.cc:260] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:53.388093 14824 heartbeater.cc:503] Master 127.2.55.190:43637 was elected leader, sending a full tablet report...
I20260811 16:47:53.388228 14870 ts_tablet_manager.cc:1428] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:47:53.388386 14401 heartbeater.cc:503] Master 127.2.55.190:43637 was elected leader, sending a full tablet report...
W20260811 16:47:53.393546 14608 tablet.cc:2369] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:47:53.467676 14402 tablet.cc:2369] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:47:53.575850 14825 tablet.cc:2369] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:47:53.683691 14875 raft_consensus.cc:482] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:53.683827 14875 raft_consensus.cc:504] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:53.684302 14875 leader_election.cc:288] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 615e81324be24310b2c3711e7593ef65 (127.2.55.129:45087), 713daa5fce304e848d342075f892955f (127.2.55.130:44571)
I20260811 16:47:53.687290 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.684658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:47963 (local address 127.2.55.130:44571)
0811 16:47:53.684708 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:53.684711 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:53.684724 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:47:53.684808 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:53.684809 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:53.684828 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:53.684931 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:53.685092 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.685599 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.686537 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.686904 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.687003 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.687013 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:53.687185 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 16:47:53.687227 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:47:53.687311 14657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.684564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:44571 (local address 127.2.55.131:47963)
0811 16:47:53.684626 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:53.684638 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:53.684715 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:53.684937 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:53.684938 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:53.684940 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:53.685015 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.685017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.685704 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.685705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.686441 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.686443 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.687003 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.687004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.687090 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.687093 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:47:53.687170 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 16:47:53.687214 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 16:47:53.687397 14865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.684705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:33641 (local address 127.2.55.129:45087)
0811 16:47:53.684749 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:53.684750 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:53.684914 (+ 164us) server_negotiation.cc:407] Connection header received
0811 16:47:53.685000 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:53.685001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:53.685020 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:53.685086 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:53.685245 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.685759 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.686665 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.687025 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.687126 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.687133 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:53.687299 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 16:47:53.687337 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:47:53.687404 14877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.684564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:45087 (local address 127.2.55.131:33641)
0811 16:47:53.684811 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:53.684820 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:53.684928 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:53.685089 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:53.685090 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:53.685092 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:53.685171 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.685172 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.685842 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.685843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.686560 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.686562 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.687132 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.687133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:53.687213 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.687216 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:47:53.687280 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:47:53.687321 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"mutex_wait_us":72,"thread_start_us":94,"threads_started":1}
I20260811 16:47:53.687700 14540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ad6bf28f7c64c33b40e2ee31194b54a" candidate_uuid: "d1462d70f0084118a395abca36729fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "713daa5fce304e848d342075f892955f" is_pre_election: true
I20260811 16:47:53.687896 14540 raft_consensus.cc:2454] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1462d70f0084118a395abca36729fc4 in term 0.
I20260811 16:47:53.687947 14316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ad6bf28f7c64c33b40e2ee31194b54a" candidate_uuid: "d1462d70f0084118a395abca36729fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "615e81324be24310b2c3711e7593ef65" is_pre_election: true
I20260811 16:47:53.688141 14316 raft_consensus.cc:2454] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1462d70f0084118a395abca36729fc4 in term 0.
I20260811 16:47:53.688145 14649 leader_election.cc:302] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 713daa5fce304e848d342075f892955f, d1462d70f0084118a395abca36729fc4; no voters:
I20260811 16:47:53.688280 14875 raft_consensus.cc:2781] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:53.688361 14875 raft_consensus.cc:482] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:53.688388 14875 raft_consensus.cc:3037] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:53.689369 14875 raft_consensus.cc:504] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:53.689513 14875 leader_election.cc:288] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 615e81324be24310b2c3711e7593ef65 (127.2.55.129:45087), 713daa5fce304e848d342075f892955f (127.2.55.130:44571)
I20260811 16:47:53.689683 14316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ad6bf28f7c64c33b40e2ee31194b54a" candidate_uuid: "d1462d70f0084118a395abca36729fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "615e81324be24310b2c3711e7593ef65"
I20260811 16:47:53.689697 14540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ad6bf28f7c64c33b40e2ee31194b54a" candidate_uuid: "d1462d70f0084118a395abca36729fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "713daa5fce304e848d342075f892955f"
I20260811 16:47:53.689762 14316 raft_consensus.cc:3037] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:53.689762 14540 raft_consensus.cc:3037] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:53.690586 14540 raft_consensus.cc:2454] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1462d70f0084118a395abca36729fc4 in term 1.
I20260811 16:47:53.690595 14316 raft_consensus.cc:2454] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1462d70f0084118a395abca36729fc4 in term 1.
I20260811 16:47:53.690766 14649 leader_election.cc:302] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 713daa5fce304e848d342075f892955f, d1462d70f0084118a395abca36729fc4; no voters:
I20260811 16:47:53.690860 14875 raft_consensus.cc:2781] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:53.691023 14875 raft_consensus.cc:686] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [term 1 LEADER]: Becoming Leader. State: Replica: d1462d70f0084118a395abca36729fc4, State: Running, Role: LEADER
I20260811 16:47:53.691139 14875 consensus_queue.cc:237] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:53.692103 14108 catalog_manager.cc:5495] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1462d70f0084118a395abca36729fc4 (127.2.55.131). New cstate: current_term: 1 leader_uuid: "d1462d70f0084118a395abca36729fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } health_report { overall_health: UNKNOWN } } }
I20260811 16:47:53.731521 14863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.729143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44928 (local address 127.2.55.131:35077)
0811 16:47:53.729206 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:53.729209 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:53.729222 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:47:53.729295 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:53.729296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:53.729316 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:53.729382 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:53.729510 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.730112 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.730830 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.731008 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.731059 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:53.731238 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:53.731339 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:53.731399 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:53.731442 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 16:47:53.731461 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:47:53.733592 14316 raft_consensus.cc:1261] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65 [term 1 FOLLOWER]: Refusing update from remote peer d1462d70f0084118a395abca36729fc4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:53.733597 14540 raft_consensus.cc:1261] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Refusing update from remote peer d1462d70f0084118a395abca36729fc4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:53.733978 14878 consensus_queue.cc:1035] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:53.734099 14875 consensus_queue.cc:1035] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:53.736738 14884 mvcc.cc:205] Tried to move back new op lower bound from 7317368314809769984 to 7317368314639618048. Current Snapshot: MvccSnapshot[applied={T|T < 7317368314809769984}]
I20260811 16:47:53.737043 14885 mvcc.cc:205] Tried to move back new op lower bound from 7317368314809769984 to 7317368314639618048. Current Snapshot: MvccSnapshot[applied={T|T < 7317368314809769984}]
I20260811 16:47:53.738672 14106 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:53.738772 14106 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:53.739586 14106 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1: Sending DeleteTablet for 3 replicas of tablet 7ad6bf28f7c64c33b40e2ee31194b54a
I20260811 16:47:53.739917 14307 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ad6bf28f7c64c33b40e2ee31194b54a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:53 UTC) from {username='oryx', principal='oryx/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:47900
I20260811 16:47:53.739953 14507 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ad6bf28f7c64c33b40e2ee31194b54a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:53 UTC) from {username='oryx', principal='oryx/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:46470
I20260811 16:47:53.740021 14723 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ad6bf28f7c64c33b40e2ee31194b54a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:53 UTC) from {username='oryx', principal='oryx/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:44922
I20260811 16:47:53.740242 14106 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57074:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:47:53.740386 14106 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:53.740666 14899 tablet_replica.cc:330] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4: stopping tablet replica
I20260811 16:47:53.740768 14899 raft_consensus.cc:2229] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:47:53.740877 14899 raft_consensus.cc:2258] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:53.741401 14899 ts_tablet_manager.cc:1905] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:53.741652 14507 tablet_service.cc:1467] Processing CreateTablet for tablet 5ddc48b90a574458b6478c714822845e (DEFAULT_TABLE table=test-table [id=ede3206432da4d75a79dd2ad6ec23cd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:53.741698 14723 tablet_service.cc:1467] Processing CreateTablet for tablet 5ddc48b90a574458b6478c714822845e (DEFAULT_TABLE table=test-table [id=ede3206432da4d75a79dd2ad6ec23cd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:53.741782 14507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ddc48b90a574458b6478c714822845e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:53.741791 14723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ddc48b90a574458b6478c714822845e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:53.743080 14867 tablet_bootstrap.cc:492] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f: Bootstrap starting.
I20260811 16:47:53.743208 14868 tablet_bootstrap.cc:492] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4: Bootstrap starting.
I20260811 16:47:53.743474 14307 tablet_service.cc:1467] Processing CreateTablet for tablet 5ddc48b90a574458b6478c714822845e (DEFAULT_TABLE table=test-table [id=ede3206432da4d75a79dd2ad6ec23cd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:53.743508 14867 tablet_bootstrap.cc:654] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:53.743587 14307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ddc48b90a574458b6478c714822845e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:53.743624 14868 tablet_bootstrap.cc:654] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:53.743970 14899 ts_tablet_manager.cc:1918] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:53.744040 14899 log.cc:1196] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/7ad6bf28f7c64c33b40e2ee31194b54a
I20260811 16:47:53.744320 14899 ts_tablet_manager.cc:1939] T 7ad6bf28f7c64c33b40e2ee31194b54a P d1462d70f0084118a395abca36729fc4: Deleting consensus metadata
I20260811 16:47:53.744995 14870 tablet_bootstrap.cc:492] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65: Bootstrap starting.
I20260811 16:47:53.745102 14867 tablet_bootstrap.cc:492] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f: No bootstrap required, opened a new log
I20260811 16:47:53.745162 14867 ts_tablet_manager.cc:1397] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:47:53.745317 14867 raft_consensus.cc:348] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:53.745389 14867 raft_consensus.cc:374] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:53.745385 14870 tablet_bootstrap.cc:654] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:53.745417 14867 raft_consensus.cc:729] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 713daa5fce304e848d342075f892955f, State: Initialized, Role: FOLLOWER
I20260811 16:47:53.745460 14867 consensus_queue.cc:260] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:53.745563 14867 ts_tablet_manager.cc:1428] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:53.745781 14868 tablet_bootstrap.cc:492] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4: No bootstrap required, opened a new log
I20260811 16:47:53.745836 14868 ts_tablet_manager.cc:1397] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260811 16:47:53.745869 14089 catalog_manager.cc:4841] TS d1462d70f0084118a395abca36729fc4 (127.2.55.131:35077): tablet 7ad6bf28f7c64c33b40e2ee31194b54a (table test-table [id=9e591095d29942039892d9d884479c05]) successfully deleted
I20260811 16:47:53.745980 14868 raft_consensus.cc:348] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:53.746058 14868 raft_consensus.cc:374] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:53.746079 14868 raft_consensus.cc:729] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1462d70f0084118a395abca36729fc4, State: Initialized, Role: FOLLOWER
I20260811 16:47:53.746135 14868 consensus_queue.cc:260] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:53.746222 14868 ts_tablet_manager.cc:1428] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:53.746366 14870 tablet_bootstrap.cc:492] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65: No bootstrap required, opened a new log
I20260811 16:47:53.746418 14870 ts_tablet_manager.cc:1397] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:53.746574 14870 raft_consensus.cc:348] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:53.746683 14870 raft_consensus.cc:374] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:53.746711 14870 raft_consensus.cc:729] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 615e81324be24310b2c3711e7593ef65, State: Initialized, Role: FOLLOWER
I20260811 16:47:53.746767 14870 consensus_queue.cc:260] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:53.746881 14870 ts_tablet_manager.cc:1428] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:53.748975 14895 tablet_replica.cc:330] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65: stopping tablet replica
I20260811 16:47:53.749100 14895 raft_consensus.cc:2229] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:53.749230 14895 raft_consensus.cc:2258] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:53.749396 14898 tablet_replica.cc:330] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f: stopping tablet replica
I20260811 16:47:53.749500 14898 raft_consensus.cc:2229] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:53.749593 14898 raft_consensus.cc:2258] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:53.749696 14895 ts_tablet_manager.cc:1905] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:53.749975 14898 ts_tablet_manager.cc:1905] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:53.751995 14898 ts_tablet_manager.cc:1918] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:53.751992 14895 ts_tablet_manager.cc:1918] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:53.752089 14898 log.cc:1196] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/7ad6bf28f7c64c33b40e2ee31194b54a
I20260811 16:47:53.752110 14895 log.cc:1196] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/wal/wals/7ad6bf28f7c64c33b40e2ee31194b54a
I20260811 16:47:53.752362 14898 ts_tablet_manager.cc:1939] T 7ad6bf28f7c64c33b40e2ee31194b54a P 713daa5fce304e848d342075f892955f: Deleting consensus metadata
I20260811 16:47:53.752388 14895 ts_tablet_manager.cc:1939] T 7ad6bf28f7c64c33b40e2ee31194b54a P 615e81324be24310b2c3711e7593ef65: Deleting consensus metadata
I20260811 16:47:53.752784 14089 catalog_manager.cc:4841] TS 713daa5fce304e848d342075f892955f (127.2.55.130:44571): tablet 7ad6bf28f7c64c33b40e2ee31194b54a (table test-table [id=9e591095d29942039892d9d884479c05]) successfully deleted
I20260811 16:47:53.752887 14085 catalog_manager.cc:4841] TS 615e81324be24310b2c3711e7593ef65 (127.2.55.129:45087): tablet 7ad6bf28f7c64c33b40e2ee31194b54a (table test-table [id=9e591095d29942039892d9d884479c05]) successfully deleted
I20260811 16:47:53.949928 14890 raft_consensus.cc:482] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:53.950044 14890 raft_consensus.cc:504] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:53.950220 14890 leader_election.cc:288] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 615e81324be24310b2c3711e7593ef65 (127.2.55.129:45087), 713daa5fce304e848d342075f892955f (127.2.55.130:44571)
I20260811 16:47:53.950490 14540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ddc48b90a574458b6478c714822845e" candidate_uuid: "d1462d70f0084118a395abca36729fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "713daa5fce304e848d342075f892955f" is_pre_election: true
I20260811 16:47:53.950578 14540 raft_consensus.cc:2454] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1462d70f0084118a395abca36729fc4 in term 0.
I20260811 16:47:53.950500 14316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ddc48b90a574458b6478c714822845e" candidate_uuid: "d1462d70f0084118a395abca36729fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "615e81324be24310b2c3711e7593ef65" is_pre_election: true
I20260811 16:47:53.950660 14316 raft_consensus.cc:2454] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1462d70f0084118a395abca36729fc4 in term 0.
I20260811 16:47:53.950770 14649 leader_election.cc:302] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 713daa5fce304e848d342075f892955f, d1462d70f0084118a395abca36729fc4; no voters:
I20260811 16:47:53.950881 14890 raft_consensus.cc:2781] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:53.950918 14890 raft_consensus.cc:482] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:53.950951 14890 raft_consensus.cc:3037] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:53.951700 14890 raft_consensus.cc:504] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:53.951856 14890 leader_election.cc:288] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 615e81324be24310b2c3711e7593ef65 (127.2.55.129:45087), 713daa5fce304e848d342075f892955f (127.2.55.130:44571)
I20260811 16:47:53.952003 14316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ddc48b90a574458b6478c714822845e" candidate_uuid: "d1462d70f0084118a395abca36729fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "615e81324be24310b2c3711e7593ef65"
I20260811 16:47:53.952100 14316 raft_consensus.cc:3037] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:53.952080 14540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ddc48b90a574458b6478c714822845e" candidate_uuid: "d1462d70f0084118a395abca36729fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "713daa5fce304e848d342075f892955f"
I20260811 16:47:53.952149 14540 raft_consensus.cc:3037] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:53.952941 14316 raft_consensus.cc:2454] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1462d70f0084118a395abca36729fc4 in term 1.
I20260811 16:47:53.952942 14540 raft_consensus.cc:2454] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1462d70f0084118a395abca36729fc4 in term 1.
I20260811 16:47:53.953157 14649 leader_election.cc:302] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 713daa5fce304e848d342075f892955f, d1462d70f0084118a395abca36729fc4; no voters:
I20260811 16:47:53.953312 14890 raft_consensus.cc:2781] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:53.953387 14890 raft_consensus.cc:686] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [term 1 LEADER]: Becoming Leader. State: Replica: d1462d70f0084118a395abca36729fc4, State: Running, Role: LEADER
I20260811 16:47:53.953445 14890 consensus_queue.cc:237] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:53.954195 14108 catalog_manager.cc:5495] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1462d70f0084118a395abca36729fc4 (127.2.55.131). New cstate: current_term: 1 leader_uuid: "d1462d70f0084118a395abca36729fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } health_report { overall_health: HEALTHY } } }
Aug 11 16:47:54 dist-test-slave-3h5h krb5kdc[14034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466872, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.190@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM
I20260811 16:47:54.005357 14914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.997873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57088 (local address 127.2.55.190:43637)
0811 16:47:53.998108 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:53.998111 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:53.998123 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:47:53.998190 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:53.998191 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:53.998205 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:53.998295 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:53.998843 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.999363 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.000134 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.000346 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.000442 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.002634 (+ 2192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:54.002636 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:54.002636 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:54.002643 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:54.003977 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:54.004408 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:54.004410 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:54.004410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:54.004480 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:54.004679 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:54.004680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:54.004680 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:54.004809 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:54.004949 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:54.005114 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 16:47:54.005237 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":77,"threads_started":1}
I20260811 16:47:54.005419 14913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:53.997776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:43637 (local address 127.0.0.1:57088)
0811 16:47:53.997999 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:53.998015 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:53.998121 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:53.998313 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:53.998314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:53.998687 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:53.998739 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:53.998742 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:53.999464 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:53.999465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:54.000013 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:54.000015 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.000442 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.000451 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:54.000516 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.001067 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:54.001073 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:54.002533 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:54.004087 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:54.004096 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:54.004099 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:54.004313 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:54.004550 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:54.004551 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:54.004551 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:54.004613 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:54.004940 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:54.004949 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:54.004998 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 16:47:54.005089 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 16:47:54.005300 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":93,"thread_start_us":115,"threads_started":1}
I20260811 16:47:54.007498 14108 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:57088:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 16:47:54.007696 14108 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:54.009326 14307 tablet_service.cc:1467] Processing CreateTablet for tablet 84a6d7a5d5af40a685192ec69b435f9d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c4ee57bbec86494ba8d12634c1857900]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:47:54.009313 14507 tablet_service.cc:1467] Processing CreateTablet for tablet 84a6d7a5d5af40a685192ec69b435f9d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c4ee57bbec86494ba8d12634c1857900]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:47:54.009316 14723 tablet_service.cc:1467] Processing CreateTablet for tablet 84a6d7a5d5af40a685192ec69b435f9d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c4ee57bbec86494ba8d12634c1857900]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:47:54.009473 14307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84a6d7a5d5af40a685192ec69b435f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:54.009479 14723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84a6d7a5d5af40a685192ec69b435f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:54.009479 14507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 84a6d7a5d5af40a685192ec69b435f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:54.010874 14870 tablet_bootstrap.cc:492] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65: Bootstrap starting.
I20260811 16:47:54.011075 14867 tablet_bootstrap.cc:492] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f: Bootstrap starting.
I20260811 16:47:54.011075 14868 tablet_bootstrap.cc:492] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4: Bootstrap starting.
I20260811 16:47:54.011291 14870 tablet_bootstrap.cc:654] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:54.011438 14868 tablet_bootstrap.cc:654] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:54.011497 14867 tablet_bootstrap.cc:654] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:54.012084 14870 tablet_bootstrap.cc:492] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65: No bootstrap required, opened a new log
I20260811 16:47:54.012158 14870 ts_tablet_manager.cc:1397] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:54.012339 14867 tablet_bootstrap.cc:492] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f: No bootstrap required, opened a new log
I20260811 16:47:54.012313 14870 raft_consensus.cc:348] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:54.012403 14867 ts_tablet_manager.cc:1397] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:54.012413 14870 raft_consensus.cc:374] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:54.012440 14870 raft_consensus.cc:729] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 615e81324be24310b2c3711e7593ef65, State: Initialized, Role: FOLLOWER
I20260811 16:47:54.012449 14868 tablet_bootstrap.cc:492] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4: No bootstrap required, opened a new log
I20260811 16:47:54.012499 14868 ts_tablet_manager.cc:1397] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:54.012492 14870 consensus_queue.cc:260] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:54.012590 14870 ts_tablet_manager.cc:1428] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:54.012560 14867 raft_consensus.cc:348] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:54.012626 14867 raft_consensus.cc:374] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:54.012648 14867 raft_consensus.cc:729] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 713daa5fce304e848d342075f892955f, State: Initialized, Role: FOLLOWER
I20260811 16:47:54.012620 14868 raft_consensus.cc:348] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:54.012691 14868 raft_consensus.cc:374] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:54.012712 14868 raft_consensus.cc:729] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1462d70f0084118a395abca36729fc4, State: Initialized, Role: FOLLOWER
I20260811 16:47:54.012692 14867 consensus_queue.cc:260] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:54.012753 14868 consensus_queue.cc:260] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:54.012697 14876 tablet_replica.cc:439] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } }
I20260811 16:47:54.012786 14867 ts_tablet_manager.cc:1428] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:54.012806 14876 tablet_replica.cc:442] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:54.012884 14868 ts_tablet_manager.cc:1428] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 16:47:54.012989 14890 tablet_replica.cc:439] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } }
I20260811 16:47:54.013060 14890 tablet_replica.cc:442] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:54.013121 14874 tablet_replica.cc:439] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } }
I20260811 16:47:54.013257 14874 tablet_replica.cc:442] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:54.095508 14876 raft_consensus.cc:482] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:54.095625 14876 raft_consensus.cc:504] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:54.095958 14876 leader_election.cc:288] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1462d70f0084118a395abca36729fc4 (127.2.55.131:35077), 713daa5fce304e848d342075f892955f (127.2.55.130:44571)
I20260811 16:47:54.099260 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:54.096552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:42667 (local address 127.2.55.130:44571)
0811 16:47:54.096598 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:54.096600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:54.096726 (+ 126us) server_negotiation.cc:407] Connection header received
0811 16:47:54.096762 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:54.096763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:54.096772 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:54.096872 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:54.097036 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.097525 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.098526 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.098897 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.098956 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.098987 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:54.099144 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 16:47:54.099195 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:47:54.099327 14863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:54.096321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:51359 (local address 127.2.55.131:35077)
0811 16:47:54.096421 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:54.096423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:54.096516 (+ 93us) server_negotiation.cc:407] Connection header received
0811 16:47:54.096604 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:54.096605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:54.096617 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:54.096689 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:47:54.096905 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.097440 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.098560 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.098911 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.099000 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.099009 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:54.099204 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 16:47:54.099248 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 16:47:54.099273 14920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:54.096463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:44571 (local address 127.2.55.129:42667)
0811 16:47:54.096639 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:54.096649 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:54.096715 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:54.096880 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:54.096881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:54.096883 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:54.096959 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:54.096961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.097633 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.097634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:54.098424 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:54.098427 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.098983 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.098984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:54.099066 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.099070 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:47:54.099120 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 16:47:54.099152 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":24,"thread_start_us":102,"threads_started":1}
I20260811 16:47:54.099581 14918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:54.096253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:35077 (local address 127.2.55.129:51359)
0811 16:47:54.096408 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:54.096420 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:54.096517 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:54.096727 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:54.096728 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:54.096731 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:47:54.096828 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:54.096830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.097528 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.097529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:54.098428 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:54.098431 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.099023 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.099024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:54.099098 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.099120 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 16:47:54.099189 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 16:47:54.099229 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":22,"thread_start_us":78,"threads_started":1}
I20260811 16:47:54.099592 14540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84a6d7a5d5af40a685192ec69b435f9d" candidate_uuid: "615e81324be24310b2c3711e7593ef65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "713daa5fce304e848d342075f892955f" is_pre_election: true
I20260811 16:47:54.099717 14540 raft_consensus.cc:2454] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 615e81324be24310b2c3711e7593ef65 in term 0.
I20260811 16:47:54.099915 14243 leader_election.cc:302] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 615e81324be24310b2c3711e7593ef65, 713daa5fce304e848d342075f892955f; no voters:
I20260811 16:47:54.099896 14753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84a6d7a5d5af40a685192ec69b435f9d" candidate_uuid: "615e81324be24310b2c3711e7593ef65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1462d70f0084118a395abca36729fc4" is_pre_election: true
I20260811 16:47:54.100009 14753 raft_consensus.cc:2454] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 615e81324be24310b2c3711e7593ef65 in term 0.
I20260811 16:47:54.100134 14876 raft_consensus.cc:2781] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:54.100183 14876 raft_consensus.cc:482] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:54.100205 14876 raft_consensus.cc:3037] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:54.100934 14876 raft_consensus.cc:504] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:54.101068 14876 leader_election.cc:288] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [CANDIDATE]: Term 1 election: Requested vote from peers d1462d70f0084118a395abca36729fc4 (127.2.55.131:35077), 713daa5fce304e848d342075f892955f (127.2.55.130:44571)
I20260811 16:47:54.101251 14753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84a6d7a5d5af40a685192ec69b435f9d" candidate_uuid: "615e81324be24310b2c3711e7593ef65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1462d70f0084118a395abca36729fc4"
I20260811 16:47:54.101262 14540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "84a6d7a5d5af40a685192ec69b435f9d" candidate_uuid: "615e81324be24310b2c3711e7593ef65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "713daa5fce304e848d342075f892955f"
I20260811 16:47:54.101332 14540 raft_consensus.cc:3037] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:54.101331 14753 raft_consensus.cc:3037] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:54.102119 14753 raft_consensus.cc:2454] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 615e81324be24310b2c3711e7593ef65 in term 1.
I20260811 16:47:54.102110 14540 raft_consensus.cc:2454] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 615e81324be24310b2c3711e7593ef65 in term 1.
I20260811 16:47:54.102327 14243 leader_election.cc:302] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 615e81324be24310b2c3711e7593ef65, 713daa5fce304e848d342075f892955f; no voters:
I20260811 16:47:54.102429 14876 raft_consensus.cc:2781] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:54.102586 14876 raft_consensus.cc:686] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [term 1 LEADER]: Becoming Leader. State: Replica: 615e81324be24310b2c3711e7593ef65, State: Running, Role: LEADER
I20260811 16:47:54.102645 14876 consensus_queue.cc:237] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } }
I20260811 16:47:54.103044 14921 tablet_replica.cc:439] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65: TxnStatusTablet state changed. Reason: New leader 615e81324be24310b2c3711e7593ef65. Latest consensus state: current_term: 1 leader_uuid: "615e81324be24310b2c3711e7593ef65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } }
I20260811 16:47:54.103140 14921 tablet_replica.cc:442] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:47:54.103335 14923 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 16:47:54.103466 14923 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 16:47:54.103367 14105 catalog_manager.cc:5495] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 615e81324be24310b2c3711e7593ef65 (127.2.55.129). New cstate: current_term: 1 leader_uuid: "615e81324be24310b2c3711e7593ef65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } health_report { overall_health: UNKNOWN } } }
I20260811 16:47:54.131557 14865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:54.128910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47906 (local address 127.2.55.129:45087)
0811 16:47:54.128980 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:54.128982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:54.128991 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:54.129078 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:54.129079 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:54.129109 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:54.129189 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:54.129344 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.129876 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.130716 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.130926 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.131018 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.131185 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:54.131301 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:54.131387 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:54.131444 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 16:47:54.131468 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:47:54.131562 14913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:54.128817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:45087 (local address 127.0.0.1:47906)
0811 16:47:54.128887 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:54.128899 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:54.128973 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:54.129209 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:54.129210 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:54.129212 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:47:54.129270 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:54.129272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.129944 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.129945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:54.130628 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:54.130630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.131001 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.131003 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:54.131060 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.131078 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:47:54.131371 (+ 293us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:47:54.131381 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 16:47:54.131438 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 16:47:54.131492 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 16:47:54.132913 14753 raft_consensus.cc:1261] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4 [term 1 FOLLOWER]: Refusing update from remote peer 615e81324be24310b2c3711e7593ef65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:54.132942 14540 raft_consensus.cc:1261] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Refusing update from remote peer 615e81324be24310b2c3711e7593ef65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:54.133235 14921 consensus_queue.cc:1035] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:54.133395 14876 consensus_queue.cc:1035] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:54.134079 14890 tablet_replica.cc:439] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4: TxnStatusTablet state changed. Reason: New leader 615e81324be24310b2c3711e7593ef65. Latest consensus state: current_term: 1 leader_uuid: "615e81324be24310b2c3711e7593ef65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } }
I20260811 16:47:54.134186 14890 tablet_replica.cc:442] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:54.134157 14874 tablet_replica.cc:439] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f: TxnStatusTablet state changed. Reason: New leader 615e81324be24310b2c3711e7593ef65. Latest consensus state: current_term: 1 leader_uuid: "615e81324be24310b2c3711e7593ef65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } }
I20260811 16:47:54.134256 14874 tablet_replica.cc:442] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:54.135026 14876 tablet_replica.cc:439] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "615e81324be24310b2c3711e7593ef65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } }
I20260811 16:47:54.135126 14876 tablet_replica.cc:442] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:47:54.135195 14881 mvcc.cc:205] Tried to move back new op lower bound from 7317368316445732864 to 7317368316325163008. Current Snapshot: MvccSnapshot[applied={T|T < 7317368316445732864}]
I20260811 16:47:54.135324 14890 tablet_replica.cc:439] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "615e81324be24310b2c3711e7593ef65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } }
I20260811 16:47:54.135391 14890 tablet_replica.cc:442] T 84a6d7a5d5af40a685192ec69b435f9d P d1462d70f0084118a395abca36729fc4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:54.135893 14921 tablet_replica.cc:439] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "615e81324be24310b2c3711e7593ef65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } }
I20260811 16:47:54.135978 14921 tablet_replica.cc:442] T 84a6d7a5d5af40a685192ec69b435f9d P 615e81324be24310b2c3711e7593ef65: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:47:54.136534 14874 tablet_replica.cc:439] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "615e81324be24310b2c3711e7593ef65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } } peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } }
I20260811 16:47:54.136626 14874 tablet_replica.cc:442] T 84a6d7a5d5af40a685192ec69b435f9d P 713daa5fce304e848d342075f892955f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:47:54.142021 14865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:54.139387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:41947 (local address 127.2.55.129:45087)
0811 16:47:54.139434 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:54.139436 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:54.139568 (+ 132us) server_negotiation.cc:407] Connection header received
0811 16:47:54.139628 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:54.139628 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:54.139637 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:54.139677 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:54.139802 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.140274 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.141409 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.141582 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.141640 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.141835 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:54.141862 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:54.141895 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:54.141952 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 16:47:54.141967 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:47:54.142086 14933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:54.139316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:45087 (local address 127.2.55.131:41947)
0811 16:47:54.139491 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:54.139502 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:54.139567 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:54.139690 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:54.139691 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:54.139693 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:47:54.139746 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:54.139748 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.140350 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.140351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:54.141331 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:54.141333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.141663 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.141664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:54.141730 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.141747 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:47:54.141899 (+ 152us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:47:54.141901 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:47:54.141951 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 16:47:54.142000 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":107,"threads_started":1}
I20260811 16:47:54.144582 14316 raft_consensus.cc:1261] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65 [term 1 FOLLOWER]: Refusing update from remote peer d1462d70f0084118a395abca36729fc4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:54.144747 14540 raft_consensus.cc:1261] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Refusing update from remote peer d1462d70f0084118a395abca36729fc4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:54.144918 14890 consensus_queue.cc:1035] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:54.145006 14875 consensus_queue.cc:1035] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:54.154476 14939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:54.151476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:35077 (local address 127.2.55.129:48579)
0811 16:47:54.151647 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:54.151659 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:54.151712 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:54.151906 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:54.151907 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:54.151909 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:47:54.151991 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:54.151993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.152644 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.152646 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:54.153563 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:54.153566 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.154072 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.154073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:54.154144 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.154160 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:47:54.154343 (+ 183us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:47:54.154344 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:47:54.154374 (+ 30us) client_negotiation.cc:240] Negotiation successful
0811 16:47:54.154407 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":82,"threads_started":1}
I20260811 16:47:54.154479 14863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:54.151697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:48579 (local address 127.2.55.131:35077)
0811 16:47:54.151785 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:54.151787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:54.151794 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:47:54.151814 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:54.151815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:54.151835 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:54.151902 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:54.152084 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.152551 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.153649 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.153966 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.154036 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.154245 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:54.154283 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:54.154344 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:54.154378 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 16:47:54.154401 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 16:47:54.163396 14106 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:54.163528 14106 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:54.164229 14106 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1: Sending DeleteTablet for 3 replicas of tablet 5ddc48b90a574458b6478c714822845e
I20260811 16:47:54.164506 14307 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ddc48b90a574458b6478c714822845e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:54 UTC) from {username='oryx', principal='oryx/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:47900
I20260811 16:47:54.164505 14507 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ddc48b90a574458b6478c714822845e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:54 UTC) from {username='oryx', principal='oryx/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:46470
I20260811 16:47:54.164517 14723 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ddc48b90a574458b6478c714822845e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:54 UTC) from {username='oryx', principal='oryx/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:44922
I20260811 16:47:54.164609 14899 tablet_replica.cc:330] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4: stopping tablet replica
I20260811 16:47:54.164610 14895 tablet_replica.cc:330] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65: stopping tablet replica
I20260811 16:47:54.164660 14895 raft_consensus.cc:2229] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:54.164664 14899 raft_consensus.cc:2229] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:47:54.164692 14895 raft_consensus.cc:2258] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:54.164718 14899 raft_consensus.cc:2258] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:54.164793 14898 tablet_replica.cc:330] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f: stopping tablet replica
I20260811 16:47:54.164876 14898 raft_consensus.cc:2229] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:54.164919 14898 raft_consensus.cc:2258] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:54.165068 14895 ts_tablet_manager.cc:1905] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:54.165285 14899 ts_tablet_manager.cc:1905] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:54.167057 14895 ts_tablet_manager.cc:1918] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:47:54.167057 14899 ts_tablet_manager.cc:1918] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:47:54.167117 14895 log.cc:1196] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/wal/wals/5ddc48b90a574458b6478c714822845e
I20260811 16:47:54.167117 14899 log.cc:1196] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/5ddc48b90a574458b6478c714822845e
I20260811 16:47:54.167346 14895 ts_tablet_manager.cc:1939] T 5ddc48b90a574458b6478c714822845e P 615e81324be24310b2c3711e7593ef65: Deleting consensus metadata
I20260811 16:47:54.167354 14899 ts_tablet_manager.cc:1939] T 5ddc48b90a574458b6478c714822845e P d1462d70f0084118a395abca36729fc4: Deleting consensus metadata
I20260811 16:47:54.167682 14085 catalog_manager.cc:4841] TS 615e81324be24310b2c3711e7593ef65 (127.2.55.129:45087): tablet 5ddc48b90a574458b6478c714822845e (table test-table [id=ede3206432da4d75a79dd2ad6ec23cd2]) successfully deleted
I20260811 16:47:54.167837 14089 catalog_manager.cc:4841] TS d1462d70f0084118a395abca36729fc4 (127.2.55.131:35077): tablet 5ddc48b90a574458b6478c714822845e (table test-table [id=ede3206432da4d75a79dd2ad6ec23cd2]) successfully deleted
I20260811 16:47:54.168987 14898 ts_tablet_manager.cc:1905] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:54.170423 14898 ts_tablet_manager.cc:1918] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:47:54.170522 14898 log.cc:1196] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/5ddc48b90a574458b6478c714822845e
I20260811 16:47:54.170738 14898 ts_tablet_manager.cc:1939] T 5ddc48b90a574458b6478c714822845e P 713daa5fce304e848d342075f892955f: Deleting consensus metadata
I20260811 16:47:54.171123 14089 catalog_manager.cc:4841] TS 713daa5fce304e848d342075f892955f (127.2.55.130:44571): tablet 5ddc48b90a574458b6478c714822845e (table test-table [id=ede3206432da4d75a79dd2ad6ec23cd2]) successfully deleted
Aug 11 16:47:54 dist-test-slave-3h5h krb5kdc[14034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 16:47:54 dist-test-slave-3h5h krb5kdc[14034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:47:54 dist-test-slave-3h5h krb5kdc[14034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 16:47:54.203953 14914 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:54.197893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57100 (local address 127.2.55.190:43637)
0811 16:47:54.197975 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:54.197978 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:54.198042 (+ 64us) server_negotiation.cc:407] Connection header received
0811 16:47:54.198128 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:54.198130 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:54.198143 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:54.198206 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:54.198818 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.199606 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.200357 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.200663 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.200747 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.203881 (+ 3134us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57100: BlockingRecv error: recv got EOF from 127.0.0.1:57100 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 16:47:54 dist-test-slave-3h5h krb5kdc[14034](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM
I20260811 16:47:54.212293 14914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:54.204775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57104 (local address 127.2.55.190:43637)
0811 16:47:54.204827 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:54.204829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:54.204878 (+ 49us) server_negotiation.cc:407] Connection header received
0811 16:47:54.204952 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:54.204953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:54.204962 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:54.205014 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:54.205592 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.206051 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.207028 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.207222 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.207276 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.209719 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:54.209721 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:54.209721 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:54.209730 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:54.211139 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:54.211511 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:54.211513 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:54.211513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:54.211574 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:54.211775 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:54.211776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:54.211776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:54.211890 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:54.212007 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:54.212104 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 16:47:54.212186 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 16:47:54.213835 14106 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:47:54.214030 14106 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:54.215582 14307 tablet_service.cc:1467] Processing CreateTablet for tablet b01e785f8d194111ab5e5d8cbf4f233f (DEFAULT_TABLE table=test-table [id=e4e9dc417e3047aeb30fd02a0710d0ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:54.215637 14507 tablet_service.cc:1467] Processing CreateTablet for tablet b01e785f8d194111ab5e5d8cbf4f233f (DEFAULT_TABLE table=test-table [id=e4e9dc417e3047aeb30fd02a0710d0ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:54.215739 14307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b01e785f8d194111ab5e5d8cbf4f233f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:54.215751 14507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b01e785f8d194111ab5e5d8cbf4f233f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:54.215713 14723 tablet_service.cc:1467] Processing CreateTablet for tablet b01e785f8d194111ab5e5d8cbf4f233f (DEFAULT_TABLE table=test-table [id=e4e9dc417e3047aeb30fd02a0710d0ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:54.215853 14723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b01e785f8d194111ab5e5d8cbf4f233f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:54.217154 14870 tablet_bootstrap.cc:492] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65: Bootstrap starting.
I20260811 16:47:54.217154 14867 tablet_bootstrap.cc:492] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f: Bootstrap starting.
I20260811 16:47:54.217597 14870 tablet_bootstrap.cc:654] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:54.217687 14867 tablet_bootstrap.cc:654] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:54.218050 14868 tablet_bootstrap.cc:492] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4: Bootstrap starting.
I20260811 16:47:54.218408 14868 tablet_bootstrap.cc:654] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:54.218456 14870 tablet_bootstrap.cc:492] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65: No bootstrap required, opened a new log
I20260811 16:47:54.218501 14870 ts_tablet_manager.cc:1397] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:54.218708 14870 raft_consensus.cc:348] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.218783 14870 raft_consensus.cc:374] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:54.218808 14870 raft_consensus.cc:729] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 615e81324be24310b2c3711e7593ef65, State: Initialized, Role: FOLLOWER
I20260811 16:47:54.218860 14870 consensus_queue.cc:260] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.218950 14870 ts_tablet_manager.cc:1428] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:54.218943 14867 tablet_bootstrap.cc:492] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f: No bootstrap required, opened a new log
I20260811 16:47:54.218992 14867 ts_tablet_manager.cc:1397] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 16:47:54.219147 14867 raft_consensus.cc:348] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.219219 14867 raft_consensus.cc:374] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:54.219239 14867 raft_consensus.cc:729] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 713daa5fce304e848d342075f892955f, State: Initialized, Role: FOLLOWER
I20260811 16:47:54.219285 14867 consensus_queue.cc:260] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.219370 14867 ts_tablet_manager.cc:1428] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:54.219947 14868 tablet_bootstrap.cc:492] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4: No bootstrap required, opened a new log
I20260811 16:47:54.220016 14868 ts_tablet_manager.cc:1397] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:47:54.220124 14868 raft_consensus.cc:348] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.220214 14868 raft_consensus.cc:374] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:54.220243 14868 raft_consensus.cc:729] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1462d70f0084118a395abca36729fc4, State: Initialized, Role: FOLLOWER
I20260811 16:47:54.220285 14868 consensus_queue.cc:260] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.220378 14868 ts_tablet_manager.cc:1428] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:54.391044 14934 raft_consensus.cc:482] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:54.391229 14934 raft_consensus.cc:504] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.391472 14934 leader_election.cc:288] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 713daa5fce304e848d342075f892955f (127.2.55.130:44571), d1462d70f0084118a395abca36729fc4 (127.2.55.131:35077)
I20260811 16:47:54.391798 14540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b01e785f8d194111ab5e5d8cbf4f233f" candidate_uuid: "615e81324be24310b2c3711e7593ef65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "713daa5fce304e848d342075f892955f" is_pre_election: true
I20260811 16:47:54.391922 14540 raft_consensus.cc:2454] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 615e81324be24310b2c3711e7593ef65 in term 0.
I20260811 16:47:54.391848 14753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b01e785f8d194111ab5e5d8cbf4f233f" candidate_uuid: "615e81324be24310b2c3711e7593ef65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1462d70f0084118a395abca36729fc4" is_pre_election: true
I20260811 16:47:54.391978 14753 raft_consensus.cc:2454] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 615e81324be24310b2c3711e7593ef65 in term 0.
I20260811 16:47:54.392136 14243 leader_election.cc:302] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 615e81324be24310b2c3711e7593ef65, d1462d70f0084118a395abca36729fc4; no voters:
I20260811 16:47:54.392258 14934 raft_consensus.cc:2781] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:54.392333 14934 raft_consensus.cc:482] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:54.392370 14934 raft_consensus.cc:3037] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:54.393257 14934 raft_consensus.cc:504] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.393411 14934 leader_election.cc:288] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [CANDIDATE]: Term 1 election: Requested vote from peers 713daa5fce304e848d342075f892955f (127.2.55.130:44571), d1462d70f0084118a395abca36729fc4 (127.2.55.131:35077)
I20260811 16:47:54.393584 14540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b01e785f8d194111ab5e5d8cbf4f233f" candidate_uuid: "615e81324be24310b2c3711e7593ef65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "713daa5fce304e848d342075f892955f"
I20260811 16:47:54.393680 14540 raft_consensus.cc:3037] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:54.393647 14753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b01e785f8d194111ab5e5d8cbf4f233f" candidate_uuid: "615e81324be24310b2c3711e7593ef65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1462d70f0084118a395abca36729fc4"
I20260811 16:47:54.393741 14753 raft_consensus.cc:3037] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:54.394369 14540 raft_consensus.cc:2454] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 615e81324be24310b2c3711e7593ef65 in term 1.
I20260811 16:47:54.394371 14753 raft_consensus.cc:2454] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 615e81324be24310b2c3711e7593ef65 in term 1.
I20260811 16:47:54.394578 14243 leader_election.cc:302] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 615e81324be24310b2c3711e7593ef65, d1462d70f0084118a395abca36729fc4; no voters:
I20260811 16:47:54.394716 14934 raft_consensus.cc:2781] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:54.394800 14934 raft_consensus.cc:686] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [term 1 LEADER]: Becoming Leader. State: Replica: 615e81324be24310b2c3711e7593ef65, State: Running, Role: LEADER
I20260811 16:47:54.394860 14934 consensus_queue.cc:237] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.395550 14106 catalog_manager.cc:5495] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 615e81324be24310b2c3711e7593ef65 (127.2.55.129). New cstate: current_term: 1 leader_uuid: "615e81324be24310b2c3711e7593ef65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } health_report { overall_health: UNKNOWN } } }
I20260811 16:47:54.402796 14865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:54.400416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47914 (local address 127.2.55.129:45087)
0811 16:47:54.400465 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:54.400467 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:54.400476 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:54.400541 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:54.400542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:54.400555 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:54.400638 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:54.400788 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.401320 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.402073 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.402276 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.402353 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.402517 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:54.402553 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:54.402629 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:54.402689 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 16:47:54.402709 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:47:54.403728 14753 raft_consensus.cc:1261] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4 [term 1 FOLLOWER]: Refusing update from remote peer 615e81324be24310b2c3711e7593ef65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:54.403729 14540 raft_consensus.cc:1261] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Refusing update from remote peer 615e81324be24310b2c3711e7593ef65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:54.403990 14876 consensus_queue.cc:1035] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:54.404095 14934 consensus_queue.cc:1035] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:54.407486 14106 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:54.407590 14106 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:54.408233 14106 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1: Sending DeleteTablet for 3 replicas of tablet b01e785f8d194111ab5e5d8cbf4f233f
I20260811 16:47:54.408511 14307 tablet_service.cc:1514] Processing DeleteTablet for tablet b01e785f8d194111ab5e5d8cbf4f233f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:54 UTC) from {username='oryx', principal='oryx/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:47900
I20260811 16:47:54.408638 14895 tablet_replica.cc:330] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65: stopping tablet replica
I20260811 16:47:54.408691 14895 raft_consensus.cc:2229] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:47:54.408787 14895 raft_consensus.cc:2258] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:54.408826 14723 tablet_service.cc:1514] Processing DeleteTablet for tablet b01e785f8d194111ab5e5d8cbf4f233f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:54 UTC) from {username='oryx', principal='oryx/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:44922
I20260811 16:47:54.408874 14507 tablet_service.cc:1514] Processing DeleteTablet for tablet b01e785f8d194111ab5e5d8cbf4f233f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:54 UTC) from {username='oryx', principal='oryx/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:46470
I20260811 16:47:54.408941 14899 tablet_replica.cc:330] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4: stopping tablet replica
I20260811 16:47:54.408972 14898 tablet_replica.cc:330] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f: stopping tablet replica
I20260811 16:47:54.408994 14899 raft_consensus.cc:2229] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:54.409040 14899 raft_consensus.cc:2258] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:54.409034 14898 raft_consensus.cc:2229] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:54.409085 14898 raft_consensus.cc:2258] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:54.409196 14106 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:47:54.409363 14106 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:47:54.409376 14899 ts_tablet_manager.cc:1905] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:54.409749 14895 ts_tablet_manager.cc:1905] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:54.410997 14899 ts_tablet_manager.cc:1918] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:54.410997 14895 ts_tablet_manager.cc:1918] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:54.411058 14899 log.cc:1196] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/b01e785f8d194111ab5e5d8cbf4f233f
I20260811 16:47:54.411058 14895 log.cc:1196] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-0/wal/wals/b01e785f8d194111ab5e5d8cbf4f233f
I20260811 16:47:54.411275 14898 ts_tablet_manager.cc:1905] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:54.411295 14899 ts_tablet_manager.cc:1939] T b01e785f8d194111ab5e5d8cbf4f233f P d1462d70f0084118a395abca36729fc4: Deleting consensus metadata
I20260811 16:47:54.411295 14895 ts_tablet_manager.cc:1939] T b01e785f8d194111ab5e5d8cbf4f233f P 615e81324be24310b2c3711e7593ef65: Deleting consensus metadata
I20260811 16:47:54.412449 14307 tablet_service.cc:1467] Processing CreateTablet for tablet 2b2969056a2f4166bd2cc279ce1af8a1 (DEFAULT_TABLE table=test-table [id=b878e1ce8d80472eb15d5c55e08daa96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:54.412449 14507 tablet_service.cc:1467] Processing CreateTablet for tablet 2b2969056a2f4166bd2cc279ce1af8a1 (DEFAULT_TABLE table=test-table [id=b878e1ce8d80472eb15d5c55e08daa96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:54.412560 14307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b2969056a2f4166bd2cc279ce1af8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:54.412560 14507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b2969056a2f4166bd2cc279ce1af8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:54.412815 14898 ts_tablet_manager.cc:1918] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:47:54.412887 14898 log.cc:1196] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/b01e785f8d194111ab5e5d8cbf4f233f
I20260811 16:47:54.413021 14723 tablet_service.cc:1467] Processing CreateTablet for tablet 2b2969056a2f4166bd2cc279ce1af8a1 (DEFAULT_TABLE table=test-table [id=b878e1ce8d80472eb15d5c55e08daa96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:47:54.413108 14898 ts_tablet_manager.cc:1939] T b01e785f8d194111ab5e5d8cbf4f233f P 713daa5fce304e848d342075f892955f: Deleting consensus metadata
I20260811 16:47:54.413123 14723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b2969056a2f4166bd2cc279ce1af8a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:54.413897 14867 tablet_bootstrap.cc:492] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f: Bootstrap starting.
I20260811 16:47:54.414286 14867 tablet_bootstrap.cc:654] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:54.414323 14868 tablet_bootstrap.cc:492] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4: Bootstrap starting.
I20260811 16:47:54.414422 14085 catalog_manager.cc:4841] TS 615e81324be24310b2c3711e7593ef65 (127.2.55.129:45087): tablet b01e785f8d194111ab5e5d8cbf4f233f (table test-table [id=e4e9dc417e3047aeb30fd02a0710d0ba]) successfully deleted
I20260811 16:47:54.414641 14868 tablet_bootstrap.cc:654] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:54.415273 14868 tablet_bootstrap.cc:492] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4: No bootstrap required, opened a new log
I20260811 16:47:54.415313 14868 ts_tablet_manager.cc:1397] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:54.415413 14868 raft_consensus.cc:348] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.415482 14868 raft_consensus.cc:374] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:54.415503 14868 raft_consensus.cc:729] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1462d70f0084118a395abca36729fc4, State: Initialized, Role: FOLLOWER
I20260811 16:47:54.415556 14868 consensus_queue.cc:260] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.415665 14868 ts_tablet_manager.cc:1428] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:54.415710 14870 tablet_bootstrap.cc:492] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65: Bootstrap starting.
I20260811 16:47:54.415969 14870 tablet_bootstrap.cc:654] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:54.416370 14089 catalog_manager.cc:4841] TS 713daa5fce304e848d342075f892955f (127.2.55.130:44571): tablet b01e785f8d194111ab5e5d8cbf4f233f (table test-table [id=e4e9dc417e3047aeb30fd02a0710d0ba]) successfully deleted
I20260811 16:47:54.416463 14089 catalog_manager.cc:4841] TS d1462d70f0084118a395abca36729fc4 (127.2.55.131:35077): tablet b01e785f8d194111ab5e5d8cbf4f233f (table test-table [id=e4e9dc417e3047aeb30fd02a0710d0ba]) successfully deleted
I20260811 16:47:54.416708 14870 tablet_bootstrap.cc:492] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65: No bootstrap required, opened a new log
I20260811 16:47:54.416749 14870 ts_tablet_manager.cc:1397] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 16:47:54.416879 14870 raft_consensus.cc:348] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.416968 14870 raft_consensus.cc:374] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:54.417001 14870 raft_consensus.cc:729] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 615e81324be24310b2c3711e7593ef65, State: Initialized, Role: FOLLOWER
I20260811 16:47:54.417047 14870 consensus_queue.cc:260] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.417135 14870 ts_tablet_manager.cc:1428] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:54.417505 14867 tablet_bootstrap.cc:492] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f: No bootstrap required, opened a new log
I20260811 16:47:54.417560 14867 ts_tablet_manager.cc:1397] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260811 16:47:54.417735 14867 raft_consensus.cc:348] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.417807 14867 raft_consensus.cc:374] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:54.417829 14867 raft_consensus.cc:729] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 713daa5fce304e848d342075f892955f, State: Initialized, Role: FOLLOWER
I20260811 16:47:54.417868 14867 consensus_queue.cc:260] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.417984 14867 ts_tablet_manager.cc:1428] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 16:47:54.611176 14876 raft_consensus.cc:482] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:47:54.611316 14876 raft_consensus.cc:504] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.611507 14876 leader_election.cc:288] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 713daa5fce304e848d342075f892955f (127.2.55.130:44571), d1462d70f0084118a395abca36729fc4 (127.2.55.131:35077)
I20260811 16:47:54.611816 14540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b2969056a2f4166bd2cc279ce1af8a1" candidate_uuid: "615e81324be24310b2c3711e7593ef65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "713daa5fce304e848d342075f892955f" is_pre_election: true
I20260811 16:47:54.611837 14753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b2969056a2f4166bd2cc279ce1af8a1" candidate_uuid: "615e81324be24310b2c3711e7593ef65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1462d70f0084118a395abca36729fc4" is_pre_election: true
I20260811 16:47:54.611927 14540 raft_consensus.cc:2454] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 615e81324be24310b2c3711e7593ef65 in term 0.
I20260811 16:47:54.611953 14753 raft_consensus.cc:2454] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 615e81324be24310b2c3711e7593ef65 in term 0.
I20260811 16:47:54.612147 14243 leader_election.cc:302] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 615e81324be24310b2c3711e7593ef65, d1462d70f0084118a395abca36729fc4; no voters:
I20260811 16:47:54.612269 14876 raft_consensus.cc:2781] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:47:54.612314 14876 raft_consensus.cc:482] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:47:54.612345 14876 raft_consensus.cc:3037] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:54.613119 14876 raft_consensus.cc:504] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.613293 14876 leader_election.cc:288] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [CANDIDATE]: Term 1 election: Requested vote from peers 713daa5fce304e848d342075f892955f (127.2.55.130:44571), d1462d70f0084118a395abca36729fc4 (127.2.55.131:35077)
I20260811 16:47:54.613489 14753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b2969056a2f4166bd2cc279ce1af8a1" candidate_uuid: "615e81324be24310b2c3711e7593ef65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1462d70f0084118a395abca36729fc4"
I20260811 16:47:54.613488 14540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b2969056a2f4166bd2cc279ce1af8a1" candidate_uuid: "615e81324be24310b2c3711e7593ef65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "713daa5fce304e848d342075f892955f"
I20260811 16:47:54.613560 14540 raft_consensus.cc:3037] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:54.613575 14753 raft_consensus.cc:3037] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:54.614177 14540 raft_consensus.cc:2454] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 615e81324be24310b2c3711e7593ef65 in term 1.
I20260811 16:47:54.614308 14753 raft_consensus.cc:2454] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 615e81324be24310b2c3711e7593ef65 in term 1.
I20260811 16:47:54.614375 14243 leader_election.cc:302] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 615e81324be24310b2c3711e7593ef65, 713daa5fce304e848d342075f892955f; no voters:
I20260811 16:47:54.614498 14876 raft_consensus.cc:2781] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:54.614563 14876 raft_consensus.cc:686] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [term 1 LEADER]: Becoming Leader. State: Replica: 615e81324be24310b2c3711e7593ef65, State: Running, Role: LEADER
I20260811 16:47:54.614610 14876 consensus_queue.cc:237] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } }
I20260811 16:47:54.615227 14106 catalog_manager.cc:5495] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 615e81324be24310b2c3711e7593ef65 (127.2.55.129). New cstate: current_term: 1 leader_uuid: "615e81324be24310b2c3711e7593ef65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "615e81324be24310b2c3711e7593ef65" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 } health_report { overall_health: UNKNOWN } } }
I20260811 16:47:54.652078 14865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:54.650092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:41371 (local address 127.2.55.129:45087)
0811 16:47:54.650144 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:54.650147 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:54.650156 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:54.650192 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:54.650192 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:54.650200 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:54.650253 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:54.650334 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.650794 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.651536 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.651709 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.651759 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.651869 (+ 110us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:54.651893 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:54.651931 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:54.651977 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 16:47:54.651995 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":32}
I20260811 16:47:54.652084 14939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:54.650015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:45087 (local address 127.2.55.129:41371)
0811 16:47:54.650073 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:54.650085 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:54.650142 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:54.650256 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:54.650257 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:54.650258 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:47:54.650298 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:54.650300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.650859 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.650859 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:54.651464 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:54.651466 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:54.651769 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:54.651770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:54.651808 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:54.651813 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:47:54.651942 (+ 129us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:47:54.651943 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:47:54.651977 (+ 34us) client_negotiation.cc:240] Negotiation successful
0811 16:47:54.652016 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 16:47:54.654206 14753 raft_consensus.cc:1261] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4 [term 1 FOLLOWER]: Refusing update from remote peer 615e81324be24310b2c3711e7593ef65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:54.654237 14540 raft_consensus.cc:1261] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Refusing update from remote peer 615e81324be24310b2c3711e7593ef65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:54.654460 14934 consensus_queue.cc:1035] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "713daa5fce304e848d342075f892955f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 44571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:54.654574 14876 consensus_queue.cc:1035] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1462d70f0084118a395abca36729fc4" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:54.664768 14106 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:54.664919 14106 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:47:54.665598 14106 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5ecfa2fe66dd444e92a90a89450691e1: Sending DeleteTablet for 3 replicas of tablet 2b2969056a2f4166bd2cc279ce1af8a1
I20260811 16:47:54.665839 14306 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b2969056a2f4166bd2cc279ce1af8a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:54 UTC) from {username='oryx', principal='oryx/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:47900
I20260811 16:47:54.665918 14507 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b2969056a2f4166bd2cc279ce1af8a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:54 UTC) from {username='oryx', principal='oryx/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:46470
I20260811 16:47:54.665963 14895 tablet_replica.cc:330] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65: stopping tablet replica
I20260811 16:47:54.665964 14723 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b2969056a2f4166bd2cc279ce1af8a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:47:54 UTC) from {username='oryx', principal='oryx/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:44922
I20260811 16:47:54.666014 14895 raft_consensus.cc:2229] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:47:54.666070 14895 raft_consensus.cc:2258] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:54.666069 14899 tablet_replica.cc:330] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4: stopping tablet replica
I20260811 16:47:54.666083 14898 tablet_replica.cc:330] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f: stopping tablet replica
I20260811 16:47:54.666138 14899 raft_consensus.cc:2229] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:54.666160 14898 raft_consensus.cc:2229] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:47:54.666175 14899 raft_consensus.cc:2258] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:54.666199 14898 raft_consensus.cc:2258] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:47:54.666495 14899 ts_tablet_manager.cc:1905] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:54.666495 14895 ts_tablet_manager.cc:1905] T 2b2969056a2f4166bd2cc279ce1af8a1 P 615e81324be24310b2c3711e7593ef65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:54.666503 14898 ts_tablet_manager.cc:1905] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:47:54.666739 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 14210
I20260811 16:47:54.669896 14899 ts_tablet_manager.cc:1918] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:47:54.669906 14898 ts_tablet_manager.cc:1918] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:47:54.669988 14898 log.cc:1196] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/2b2969056a2f4166bd2cc279ce1af8a1
I20260811 16:47:54.669992 14899 log.cc:1196] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/2b2969056a2f4166bd2cc279ce1af8a1
I20260811 16:47:54.670224 14899 ts_tablet_manager.cc:1939] T 2b2969056a2f4166bd2cc279ce1af8a1 P d1462d70f0084118a395abca36729fc4: Deleting consensus metadata
I20260811 16:47:54.670241 14898 ts_tablet_manager.cc:1939] T 2b2969056a2f4166bd2cc279ce1af8a1 P 713daa5fce304e848d342075f892955f: Deleting consensus metadata
I20260811 16:47:54.670596 14089 catalog_manager.cc:4841] TS d1462d70f0084118a395abca36729fc4 (127.2.55.131:35077): tablet 2b2969056a2f4166bd2cc279ce1af8a1 (table test-table [id=b878e1ce8d80472eb15d5c55e08daa96]) successfully deleted
I20260811 16:47:54.670679 14089 catalog_manager.cc:4841] TS 713daa5fce304e848d342075f892955f (127.2.55.130:44571): tablet 2b2969056a2f4166bd2cc279ce1af8a1 (table test-table [id=b878e1ce8d80472eb15d5c55e08daa96]) successfully deleted
W20260811 16:47:54.683796 14085 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.55.129:45087 (error 108)
I20260811 16:47:54.684074 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 14418
I20260811 16:47:54.687740 14981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:54.684265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:45087 (local address 127.0.0.1:47928)
0811 16:47:54.687616 (+ 3351us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:54.687682 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:45087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3330,"thread_start_us":41,"threads_started":1}
W20260811 16:47:54.687844 14085 catalog_manager.cc:4584] TS 615e81324be24310b2c3711e7593ef65 (127.2.55.129:45087): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2b2969056a2f4166bd2cc279ce1af8a1: Network error: Client connection negotiation failed: client connection to 127.2.55.129:45087: connect: Connection refused (error 111)
I20260811 16:47:54.696302 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 14623
I20260811 16:47:54.709585 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 14053
2026-08-11T16:47:54Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3515 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:47:54 dist-test-slave-3h5h krb5kdc[14986](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:47:54 dist-test-slave-3h5h krb5kdc[14986](info): set up 2 sockets
Aug 11 16:47:54 dist-test-slave-3h5h krb5kdc[14986](info): commencing operation
krb5kdc: starting...
W20260811 16:47:56.039862 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.305s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:47:56 dist-test-slave-3h5h krb5kdc[14986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:47:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:47:56.179540 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:38401
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:37173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:38401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:56.264418 15006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:56.264693 15006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:56.264734 15006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:56.265946 15006 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:56.266028 15006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:56.266054 15006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:56.266085 15006 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:56.266149 15006 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:56.267765 15006 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:37173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:38401
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:38401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:56.268074 15006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:56.268319 15006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:56.273423 15017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:56.273448 15015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:56.273460 15014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:56.273569 15006 server_base.cc:1034] running on GCE node
I20260811 16:47:56.273949 15006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:56.274206 15006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:56.275347 15006 hybrid_clock.cc:648] HybridClock initialized: now 1786466876275330 us; error 42 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T16:47:56Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1573 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:47:56 dist-test-slave-3h5h krb5kdc[15023](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:47:56 dist-test-slave-3h5h krb5kdc[15023](info): set up 2 sockets
Aug 11 16:47:56 dist-test-slave-3h5h krb5kdc[15023](info): commencing operation
krb5kdc: starting...
W20260811 16:47:57.575495 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:47:57 dist-test-slave-3h5h krb5kdc[15023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466877, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:47:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:47:57.708770 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:37153
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:44417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:37153
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:57.792793 15044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:57.793032 15044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:57.793054 15044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:57.794237 15044 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:57.794281 15044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:57.794296 15044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:57.794308 15044 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:57.794320 15044 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:57.795832 15044 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:37153
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:37153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:57.796096 15044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:57.796337 15044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:57.801347 15052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:57.801352 15054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:57.801352 15051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:57.801740 15044 server_base.cc:1034] running on GCE node
I20260811 16:47:57.801951 15044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:57.802212 15044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:57.803350 15044 hybrid_clock.cc:648] HybridClock initialized: now 1786466877803336 us; error 35 us; skew 500 ppm
Aug 11 16:47:57 dist-test-slave-3h5h krb5kdc[15023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466877, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:57.805930 15044 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:47:57.806428 15044 webserver.cc:460] Webserver started at http://127.2.55.190:33463/ using document root <none> and password file <none>
I20260811 16:47:57.806659 15044 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:57.806726 15044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:57.806881 15044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:57.808004 15044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "c334fc296fd54d7ba2133db2d99fba98"
format_stamp: "Formatted at 2026-08-11 16:47:57 on dist-test-slave-3h5h"
server_key: "9e1b21751917bc42b40e287e1e542db3"
server_key_iv: "ec0252691ef3354c7e80474ab580022e"
server_key_version: "encryptionkey@0"
I20260811 16:47:57.808385 15044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "c334fc296fd54d7ba2133db2d99fba98"
format_stamp: "Formatted at 2026-08-11 16:47:57 on dist-test-slave-3h5h"
server_key: "9e1b21751917bc42b40e287e1e542db3"
server_key_iv: "ec0252691ef3354c7e80474ab580022e"
server_key_version: "encryptionkey@0"
I20260811 16:47:57.809865 15044 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:47:57.810644 15063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:57.810835 15044 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:47:57.810945 15044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "c334fc296fd54d7ba2133db2d99fba98"
format_stamp: "Formatted at 2026-08-11 16:47:57 on dist-test-slave-3h5h"
server_key: "9e1b21751917bc42b40e287e1e542db3"
server_key_iv: "ec0252691ef3354c7e80474ab580022e"
server_key_version: "encryptionkey@0"
I20260811 16:47:57.811020 15044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:57.839041 15044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:57.841578 15044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:57.841751 15044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:57.846349 15044 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:37153
I20260811 16:47:57.846410 15143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:37153 every 8 connection(s)
I20260811 16:47:57.846807 15044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:57.847774 15144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:57.850510 15144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98: Bootstrap starting.
I20260811 16:47:57.851199 15144 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:57.851588 15144 log.cc:824] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:57.852456 15144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98: No bootstrap required, opened a new log
I20260811 16:47:57.854369 15144 raft_consensus.cc:348] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c334fc296fd54d7ba2133db2d99fba98" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37153 } }
I20260811 16:47:57.854554 15144 raft_consensus.cc:374] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:47:57.854604 15144 raft_consensus.cc:729] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c334fc296fd54d7ba2133db2d99fba98, State: Initialized, Role: FOLLOWER
I20260811 16:47:57.854759 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 15044
I20260811 16:47:57.854790 15144 consensus_queue.cc:260] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c334fc296fd54d7ba2133db2d99fba98" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37153 } }
I20260811 16:47:57.854868 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:47:57.854897 15144 raft_consensus.cc:388] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:57.854945 15144 raft_consensus.cc:482] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:57.855018 15144 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:57.855101 2270 external_mini_cluster.cc:1428] Setting key b4310b5f333d96689e240254347e0799
I20260811 16:47:57.855854 15144 raft_consensus.cc:504] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c334fc296fd54d7ba2133db2d99fba98" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37153 } }
I20260811 16:47:57.855981 15144 leader_election.cc:302] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c334fc296fd54d7ba2133db2d99fba98; no voters:
I20260811 16:47:57.856227 15144 leader_election.cc:288] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:47:57.856257 15156 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:57.856498 15156 raft_consensus.cc:686] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 1 LEADER]: Becoming Leader. State: Replica: c334fc296fd54d7ba2133db2d99fba98, State: Running, Role: LEADER
I20260811 16:47:57.856663 15144 sys_catalog.cc:564] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:57.856670 15156 consensus_queue.cc:237] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c334fc296fd54d7ba2133db2d99fba98" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37153 } }
I20260811 16:47:57.857645 15158 sys_catalog.cc:455] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c334fc296fd54d7ba2133db2d99fba98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c334fc296fd54d7ba2133db2d99fba98" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37153 } } }
I20260811 16:47:57.858165 15158 sys_catalog.cc:458] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:57.857867 15157 sys_catalog.cc:455] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c334fc296fd54d7ba2133db2d99fba98. Latest consensus state: current_term: 1 leader_uuid: "c334fc296fd54d7ba2133db2d99fba98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c334fc296fd54d7ba2133db2d99fba98" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37153 } } }
I20260811 16:47:57.858433 15157 sys_catalog.cc:458] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:57.858449 15182 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:57.859252 15182 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:57.860991 15182 catalog_manager.cc:1347] Generated new cluster ID: d029900263fe4de0a0f1fe25c748b92c
I20260811 16:47:57.861047 15182 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:47:57 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466877, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:57.867103 15155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:57.855662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42316 (local address 127.2.55.190:37153)
0811 16:47:57.855840 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:57.855850 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:57.855892 (+ 42us) server_negotiation.cc:407] Connection header received
0811 16:47:57.856021 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:57.856029 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:57.856117 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:57.856270 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:57.857216 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:57.858742 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:57.859561 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:57.860070 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:57.860186 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:57.863318 (+ 3132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:57.863321 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:57.863322 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:57.863334 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:57.865349 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:57.865813 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:57.865816 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:57.865816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:57.865928 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:57.866173 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:57.866174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:57.866175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:57.866461 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:57.866628 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:57.866769 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 16:47:57.866900 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":125,"thread_start_us":96,"threads_started":1}
I20260811 16:47:57.888165 15182 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:57.888774 15182 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:57.891016 15182 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98: Generated new TSK 0
I20260811 16:47:57.891242 15182 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:47:57.933612 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:37153
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:44417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:58.021502 15189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:58.021730 15189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:58.021768 15189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:58.022902 15189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:58.022969 15189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:58.023013 15189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:47:58.024487 15189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:37153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:58.024765 15189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:58.025031 15189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:58.030375 15199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:58.030371 15195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:58.030449 15196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:58.030707 15189 server_base.cc:1034] running on GCE node
I20260811 16:47:58.030905 15189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:58.031147 15189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:58.032290 15189 hybrid_clock.cc:648] HybridClock initialized: now 1786466878032281 us; error 35 us; skew 500 ppm
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466878, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:58.035027 15189 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:47:58.035549 15189 webserver.cc:460] Webserver started at http://127.2.55.129:36419/ using document root <none> and password file <none>
I20260811 16:47:58.035812 15189 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:58.035859 15189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:58.036015 15189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:58.037165 15189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "191913f6ec5f4b4a9970928e5a793933"
format_stamp: "Formatted at 2026-08-11 16:47:58 on dist-test-slave-3h5h"
server_key: "fde30daa22034fce8b0821249e876108"
server_key_iv: "87fd69146b763f57daaa27bdcb518b98"
server_key_version: "encryptionkey@0"
I20260811 16:47:58.037515 15189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "191913f6ec5f4b4a9970928e5a793933"
format_stamp: "Formatted at 2026-08-11 16:47:58 on dist-test-slave-3h5h"
server_key: "fde30daa22034fce8b0821249e876108"
server_key_iv: "87fd69146b763f57daaa27bdcb518b98"
server_key_version: "encryptionkey@0"
I20260811 16:47:58.038883 15189 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:47:58.039745 15206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:58.039979 15189 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:58.040069 15189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "191913f6ec5f4b4a9970928e5a793933"
format_stamp: "Formatted at 2026-08-11 16:47:58 on dist-test-slave-3h5h"
server_key: "fde30daa22034fce8b0821249e876108"
server_key_iv: "87fd69146b763f57daaa27bdcb518b98"
server_key_version: "encryptionkey@0"
I20260811 16:47:58.040131 15189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:58.050508 15189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:58.052574 15189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:58.052699 15189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:58.052968 15189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:58.053268 15189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:58.053308 15189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:58.053331 15189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:58.053344 15189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:58.059942 15189 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:44351
I20260811 16:47:58.060122 15383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:44351 every 8 connection(s)
I20260811 16:47:58.060410 15189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466878, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:58.070617 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 15189
I20260811 16:47:58.070788 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:47:58.071132 2270 external_mini_cluster.cc:1428] Setting key d7c92780082965e4a1220b0eb4ad4b22
I20260811 16:47:58.071615 15155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:58.061546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:37309 (local address 127.2.55.190:37153)
0811 16:47:58.061662 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:58.061665 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:58.061849 (+ 184us) server_negotiation.cc:407] Connection header received
0811 16:47:58.062399 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:58.062400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:58.062413 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:58.062480 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:58.063484 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.064005 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.065100 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.065325 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.065418 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.067898 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:58.067900 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:58.067900 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:58.067909 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:58.069583 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:58.070032 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:58.070033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:58.070034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:58.070191 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:58.070725 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:58.070731 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:58.070732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:58.070932 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:58.071103 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:58.071397 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 16:47:58.071518 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 16:47:58.071834 15386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:58.061477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:37309)
0811 16:47:58.061699 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:58.061749 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:58.062284 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:58.062554 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:58.062558 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:58.063164 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:58.063369 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.063374 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.064113 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.064115 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.064961 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.064963 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.065435 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.065437 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.065576 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.066188 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:58.066198 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:58.067783 (+ 1585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:58.069693 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:58.069703 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:58.069705 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:58.069945 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:58.070454 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:58.070456 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:58.070457 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:58.070634 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:58.071022 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:58.071031 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:58.071208 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 16:47:58.071371 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 16:47:58.071571 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":98,"threads_started":1}
I20260811 16:47:58.072583 15384 heartbeater.cc:347] Connected to a master server at 127.2.55.190:37153
I20260811 16:47:58.072695 15384 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:58.072973 15384 heartbeater.cc:511] Master 127.2.55.190:37153 requested a full tablet report, sending...
I20260811 16:47:58.073616 15087 ts_manager.cc:194] Registered new tserver with Master: 191913f6ec5f4b4a9970928e5a793933 (127.2.55.129:44351)
I20260811 16:47:58.074453 15087 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:37309
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:47:58.102417 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:37153
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:44417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:58.187001 15389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:58.187268 15389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:58.187310 15389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:58.188627 15389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:58.188712 15389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:58.188758 15389 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:47:58.190289 15389 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:37153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:58.190578 15389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:58.190830 15389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:58.196161 15397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:58.196177 15403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:58.196451 15398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:58.196732 15389 server_base.cc:1034] running on GCE node
I20260811 16:47:58.197031 15389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:58.197264 15389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:58.198431 15389 hybrid_clock.cc:648] HybridClock initialized: now 1786466878198418 us; error 28 us; skew 500 ppm
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466878, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:58.201298 15389 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:47:58.201787 15389 webserver.cc:460] Webserver started at http://127.2.55.130:40679/ using document root <none> and password file <none>
I20260811 16:47:58.202051 15389 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:58.202104 15389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:58.202253 15389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:58.203384 15389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "4c25954195324aea8942caf63018b456"
format_stamp: "Formatted at 2026-08-11 16:47:58 on dist-test-slave-3h5h"
server_key: "6421c322dcdecac546d736bbe8eeb711"
server_key_iv: "1808de849d4febb985a6071046a2919a"
server_key_version: "encryptionkey@0"
I20260811 16:47:58.203759 15389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "4c25954195324aea8942caf63018b456"
format_stamp: "Formatted at 2026-08-11 16:47:58 on dist-test-slave-3h5h"
server_key: "6421c322dcdecac546d736bbe8eeb711"
server_key_iv: "1808de849d4febb985a6071046a2919a"
server_key_version: "encryptionkey@0"
I20260811 16:47:58.205178 15389 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:47:58.206067 15412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:58.206346 15389 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:58.206496 15389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "4c25954195324aea8942caf63018b456"
format_stamp: "Formatted at 2026-08-11 16:47:58 on dist-test-slave-3h5h"
server_key: "6421c322dcdecac546d736bbe8eeb711"
server_key_iv: "1808de849d4febb985a6071046a2919a"
server_key_version: "encryptionkey@0"
I20260811 16:47:58.206594 15389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:58.216027 15389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:58.218479 15389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:58.218691 15389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:58.218979 15389 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:58.219360 15389 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:58.219429 15389 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:58.219515 15389 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:58.219553 15389 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:58.226871 15389 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:34605
I20260811 16:47:58.226925 15605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:34605 every 8 connection(s)
I20260811 16:47:58.227372 15389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:47:58.228451 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 15389
I20260811 16:47:58.228575 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:47:58.228777 2270 external_mini_cluster.cc:1428] Setting key 4e0be908f6f4e0ef6cfd1c91c2c49d3b
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466878, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:58.238559 15155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:58.228321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:36747 (local address 127.2.55.190:37153)
0811 16:47:58.228409 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:58.228412 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:58.228654 (+ 242us) server_negotiation.cc:407] Connection header received
0811 16:47:58.229500 (+ 846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:58.229501 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:58.229511 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:58.229625 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:58.231190 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.231733 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.232785 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.233054 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.233140 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.235383 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:58.235386 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:58.235386 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:58.235395 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:58.237055 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:58.237499 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:58.237501 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:58.237501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:58.237566 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:58.237838 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:58.237839 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:58.237839 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:58.237964 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:58.238058 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:58.238357 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 16:47:58.238464 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:47:58.238752 15608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:58.228279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:36747)
0811 16:47:58.228504 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:58.228554 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:58.229348 (+ 794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:58.229741 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:58.229746 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:58.230742 (+ 996us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:58.231067 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.231076 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.231845 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.231846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.232685 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.232687 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.233149 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.233150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.233289 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.233879 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:58.233888 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:58.235279 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:58.237162 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:58.237169 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:58.237172 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:58.237401 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:58.237645 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:58.237646 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:58.237646 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:58.237761 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:58.238060 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:58.238068 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:58.238214 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 16:47:58.238321 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 16:47:58.238492 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":128,"threads_started":1}
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
I20260811 16:47:58.239522 15606 heartbeater.cc:347] Connected to a master server at 127.2.55.190:37153
I20260811 16:47:58.239673 15606 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:58.239877 15606 heartbeater.cc:511] Master 127.2.55.190:37153 requested a full tablet report, sending...
I20260811 16:47:58.240329 15087 ts_manager.cc:194] Registered new tserver with Master: 4c25954195324aea8942caf63018b456 (127.2.55.130:34605)
I20260811 16:47:58.240768 15087 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:36747
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:47:58.261628 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:37153
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:44417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:58.349321 15614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:58.349589 15614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:58.349632 15614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:58.350840 15614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:58.350908 15614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:58.350955 15614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:47:58.352597 15614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:37153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:58.352952 15614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:58.353209 15614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:58.359010 15622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:58.359208 15614 server_base.cc:1034] running on GCE node
W20260811 16:47:58.359004 15626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:58.359025 15623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:58.359570 15614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:58.359793 15614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:58.360913 15614 hybrid_clock.cc:648] HybridClock initialized: now 1786466878360880 us; error 47 us; skew 500 ppm
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466878, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:58.363714 15614 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:47:58.364212 15614 webserver.cc:460] Webserver started at http://127.2.55.131:38709/ using document root <none> and password file <none>
I20260811 16:47:58.364460 15614 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:58.364506 15614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:58.364655 15614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:58.365834 15614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "9db075b842b8411baa0b655132f5d618"
format_stamp: "Formatted at 2026-08-11 16:47:58 on dist-test-slave-3h5h"
server_key: "64c39f526e5d9ba9f776f6d7908e8bc0"
server_key_iv: "96ddb24084efbbb640548037e5930dd5"
server_key_version: "encryptionkey@0"
I20260811 16:47:58.366221 15614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "9db075b842b8411baa0b655132f5d618"
format_stamp: "Formatted at 2026-08-11 16:47:58 on dist-test-slave-3h5h"
server_key: "64c39f526e5d9ba9f776f6d7908e8bc0"
server_key_iv: "96ddb24084efbbb640548037e5930dd5"
server_key_version: "encryptionkey@0"
I20260811 16:47:58.367832 15614 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:58.368753 15636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:58.368949 15614 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:58.369064 15614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "9db075b842b8411baa0b655132f5d618"
format_stamp: "Formatted at 2026-08-11 16:47:58 on dist-test-slave-3h5h"
server_key: "64c39f526e5d9ba9f776f6d7908e8bc0"
server_key_iv: "96ddb24084efbbb640548037e5930dd5"
server_key_version: "encryptionkey@0"
I20260811 16:47:58.369168 15614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:58.383658 15614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:58.386098 15614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:58.386269 15614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:58.386521 15614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:58.386857 15614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:58.386914 15614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:58.386960 15614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:58.386993 15614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:58.393904 15614 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:38579
I20260811 16:47:58.393950 15806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:38579 every 8 connection(s)
I20260811 16:47:58.394308 15614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:47:58.398301 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 15614
I20260811 16:47:58.398407 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:47:58.398599 2270 external_mini_cluster.cc:1428] Setting key 4ee9b5784477b183dd5cdcfdbaa4a1ea
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466878, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:47:58.403800 15155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:58.395225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:39085 (local address 127.2.55.190:37153)
0811 16:47:58.395299 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:58.395301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:58.395480 (+ 179us) server_negotiation.cc:407] Connection header received
0811 16:47:58.395939 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:58.395940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:58.395952 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:58.396015 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:58.396979 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.397468 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.398680 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.398986 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.399055 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.401243 (+ 2188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:58.401245 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:58.401245 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:58.401252 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:58.402680 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:58.403031 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:58.403032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:58.403033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:58.403082 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:58.403293 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:58.403293 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:58.403293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:58.403393 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:58.403443 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:58.403674 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 16:47:58.403736 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 16:47:58.404012 15809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:58.395153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:39085)
0811 16:47:58.395334 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:58.395379 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:58.395857 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:58.396072 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:58.396075 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:58.396646 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:58.396892 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.396898 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.397548 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.397549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.398566 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.398569 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.399075 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.399077 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.399287 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.399767 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:58.399775 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:58.401162 (+ 1387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:58.402748 (+ 1586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:58.402754 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:58.402756 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:58.402966 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:58.403143 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:58.403144 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:58.403144 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:58.403238 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:58.403447 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:58.403452 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:58.403561 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 16:47:58.403645 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 16:47:58.403763 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":93,"threads_started":1}
I20260811 16:47:58.404462 15807 heartbeater.cc:347] Connected to a master server at 127.2.55.190:37153
I20260811 16:47:58.404546 15807 heartbeater.cc:464] Registering TS with master...
I20260811 16:47:58.404709 15807 heartbeater.cc:511] Master 127.2.55.190:37153 requested a full tablet report, sending...
I20260811 16:47:58.405052 15087 ts_manager.cc:194] Registered new tserver with Master: 9db075b842b8411baa0b655132f5d618 (127.2.55.131:38579)
I20260811 16:47:58.405453 15087 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:39085
I20260811 16:47:58.410557 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.129.keytab.
Entry for principal oryx/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.129.keytab.
WARNING: no policy specified for oryx/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.130.keytab.
Entry for principal oryx/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.130.keytab.
WARNING: no policy specified for oryx/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.131.keytab.
Entry for principal oryx/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.131.keytab.
I20260811 16:47:58.491698 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 15189
I20260811 16:47:58.505318 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 15389
I20260811 16:47:58.537873 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 15614
I20260811 16:47:58.556102 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 15044
I20260811 16:47:58.571069 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:37153
--webserver_interface=127.2.55.190
--webserver_port=33463
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:44417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:37153
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:58.654708 15817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:58.654919 15817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:58.654943 15817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:58.656038 15817 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:58.656085 15817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:58.656101 15817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:58.656116 15817 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:58.656133 15817 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:58.657612 15817 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:37153
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:37153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=33463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:58.657820 15817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:58.657999 15817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:58.663053 15826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:58.663148 15830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:58.663061 15827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:58.663298 15817 server_base.cc:1034] running on GCE node
I20260811 16:47:58.663556 15817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:58.663852 15817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:58.665016 15817 hybrid_clock.cc:648] HybridClock initialized: now 1786466878665011 us; error 38 us; skew 500 ppm
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466878, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:58.667616 15817 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:47:58.668110 15817 webserver.cc:460] Webserver started at http://127.2.55.190:33463/ using document root <none> and password file <none>
I20260811 16:47:58.668350 15817 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:58.668435 15817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:58.670055 15817 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:58.670862 15839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:58.671118 15817 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:58.671234 15817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "c334fc296fd54d7ba2133db2d99fba98"
format_stamp: "Formatted at 2026-08-11 16:47:57 on dist-test-slave-3h5h"
server_key: "9e1b21751917bc42b40e287e1e542db3"
server_key_iv: "ec0252691ef3354c7e80474ab580022e"
server_key_version: "encryptionkey@0"
I20260811 16:47:58.671627 15817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:58.686450 15817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:58.688603 15817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:58.688787 15817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:58.693228 15817 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:37153
I20260811 16:47:58.693264 15913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:37153 every 8 connection(s)
I20260811 16:47:58.693658 15817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:58.695151 15914 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:47:58.695856 15914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98: Bootstrap starting.
I20260811 16:47:58.696334 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 15817
I20260811 16:47:58.696655 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:44351
--local_ip_for_outbound_sockets=127.2.55.129
--tserver_master_addrs=127.2.55.190:37153
--webserver_port=36419
--webserver_interface=127.2.55.129
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:44417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.2.55.129
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:47:58.704936 15914 log.cc:824] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:58.706655 15914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:47:58.706959 15914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98: Bootstrap complete.
I20260811 16:47:58.709491 15914 raft_consensus.cc:348] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c334fc296fd54d7ba2133db2d99fba98" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37153 } }
I20260811 16:47:58.709744 15914 raft_consensus.cc:729] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c334fc296fd54d7ba2133db2d99fba98, State: Initialized, Role: FOLLOWER
I20260811 16:47:58.709954 15914 consensus_queue.cc:260] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c334fc296fd54d7ba2133db2d99fba98" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37153 } }
I20260811 16:47:58.710052 15914 raft_consensus.cc:388] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:47:58.710104 15914 raft_consensus.cc:482] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:47:58.710155 15914 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:47:58.711130 15914 raft_consensus.cc:504] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c334fc296fd54d7ba2133db2d99fba98" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37153 } }
I20260811 16:47:58.711252 15914 leader_election.cc:302] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c334fc296fd54d7ba2133db2d99fba98; no voters:
I20260811 16:47:58.711437 15914 leader_election.cc:288] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 16:47:58.711503 15920 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:47:58.711660 15920 raft_consensus.cc:686] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [term 2 LEADER]: Becoming Leader. State: Replica: c334fc296fd54d7ba2133db2d99fba98, State: Running, Role: LEADER
I20260811 16:47:58.711719 15914 sys_catalog.cc:564] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:58.711756 15920 consensus_queue.cc:237] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c334fc296fd54d7ba2133db2d99fba98" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37153 } }
I20260811 16:47:58.712040 15920 sys_catalog.cc:455] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c334fc296fd54d7ba2133db2d99fba98. Latest consensus state: current_term: 2 leader_uuid: "c334fc296fd54d7ba2133db2d99fba98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c334fc296fd54d7ba2133db2d99fba98" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37153 } } }
I20260811 16:47:58.712131 15920 sys_catalog.cc:458] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:58.712040 15922 sys_catalog.cc:455] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c334fc296fd54d7ba2133db2d99fba98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c334fc296fd54d7ba2133db2d99fba98" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37153 } } }
I20260811 16:47:58.712181 15922 sys_catalog.cc:458] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:58.712419 15932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:58.712977 15932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:58.713121 15932 catalog_manager.cc:1259] Loaded cluster ID: d029900263fe4de0a0f1fe25c748b92c
I20260811 16:47:58.713296 15932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:47:58.714553 15932 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:58.714736 15932 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c334fc296fd54d7ba2133db2d99fba98: Loaded TSK: 0
I20260811 16:47:58.714957 15932 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 16:47:58.784650 15917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:58.784916 15917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:58.784947 15917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:58.786159 15917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:58.786201 15917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:58.786228 15917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:47:58.787663 15917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.129.keytab
--principal=oryx/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:44351
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=36419
--tserver_master_addrs=127.2.55.190:37153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:58.787904 15917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:58.788172 15917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:58.793654 15960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:58.793665 15957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:58.793710 15958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:58.794224 15917 server_base.cc:1034] running on GCE node
I20260811 16:47:58.794425 15917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:58.794672 15917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:58.795838 15917 hybrid_clock.cc:648] HybridClock initialized: now 1786466878795823 us; error 31 us; skew 500 ppm
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466878, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:58.798663 15917 init.cc:377] Logged in from keytab as oryx/127.2.55.129@KRBTEST.COM (short username oryx)
I20260811 16:47:58.799227 15917 webserver.cc:460] Webserver started at http://127.2.55.129:36419/ using document root <none> and password file <none>
I20260811 16:47:58.799469 15917 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:58.799556 15917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:58.801010 15917 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:47:58.801677 15970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:58.801867 15917 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:47:58.801955 15917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "191913f6ec5f4b4a9970928e5a793933"
format_stamp: "Formatted at 2026-08-11 16:47:58 on dist-test-slave-3h5h"
server_key: "fde30daa22034fce8b0821249e876108"
server_key_iv: "87fd69146b763f57daaa27bdcb518b98"
server_key_version: "encryptionkey@0"
I20260811 16:47:58.802383 15917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:58.811347 15917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:58.813845 15917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:58.814011 15917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:58.814258 15917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:58.814616 15917 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:58.814671 15917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:58.814715 15917 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:58.814742 15917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:58.822141 15917 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:44351
I20260811 16:47:58.822178 16134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:44351 every 8 connection(s)
I20260811 16:47:58.822593 15917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:47:58.831740 16137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:58.823323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:37809)
0811 16:47:58.823503 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:58.823547 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:58.824020 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:58.824494 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:58.824497 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:58.825161 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:58.825361 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.825366 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.826995 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.826995 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.827766 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.827768 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.828548 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.828549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.828653 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.829213 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:58.829221 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:58.831589 (+ 2368us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":103,"threads_started":1}
W20260811 16:47:58.831964 16139 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:58.823404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:37809 (local address 127.2.55.190:37153)
0811 16:47:58.823614 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:58.823623 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:58.823660 (+ 37us) server_negotiation.cc:407] Connection header received
0811 16:47:58.824235 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:58.824243 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:58.824299 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:58.824455 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:58.825496 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.826890 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.827853 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.828453 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.828559 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.831770 (+ 3211us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:37809: BlockingRecv error: recv got EOF from 127.2.55.129:37809 (error 108)
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":94,"threads_started":1}
W20260811 16:47:58.832002 16135 heartbeater.cc:644] Failed to heartbeat to 127.2.55.190:37153 (0 consecutive failures): Not authorized: Failed to ping master at 127.2.55.190:37153: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
I20260811 16:47:58.832705 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 15917
I20260811 16:47:58.833047 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:34605
--local_ip_for_outbound_sockets=127.2.55.130
--tserver_master_addrs=127.2.55.190:37153
--webserver_port=40679
--webserver_interface=127.2.55.130
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:44417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.2.55.130
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:47:58.836966 16137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:58.832248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:33859)
0811 16:47:58.832443 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:58.832459 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:58.832540 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:58.832699 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:58.832700 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:58.832869 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:58.832918 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.832920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.833774 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.833775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.834287 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.834289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.834666 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.834667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.834728 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.835187 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:58.835192 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:58.836895 (+ 1703us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":121,"threads_started":1}
W20260811 16:47:58.837078 16139 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:58.832336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:33859 (local address 127.2.55.190:37153)
0811 16:47:58.832405 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:58.832407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:58.832525 (+ 118us) server_negotiation.cc:407] Connection header received
0811 16:47:58.832618 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:58.832619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:58.832634 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:58.832688 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:58.833013 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.833651 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.834392 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.834590 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.834668 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.837004 (+ 2336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:33859: BlockingRecv error: recv got EOF from 127.2.55.129:33859 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:47:58.841733 16137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:58.837500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:56249)
0811 16:47:58.837542 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:58.837552 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:58.837588 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:58.837737 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:58.837738 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:58.837865 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:58.837892 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.837893 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.838564 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.838564 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.839042 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.839044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.839432 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.839433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.839488 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.839923 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:58.839929 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:58.841647 (+ 1718us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 16:47:58.841785 16139 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:58.837544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:56249 (local address 127.2.55.190:37153)
0811 16:47:58.837592 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:58.837594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:58.837602 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:47:58.837643 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:58.837644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:58.837655 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:58.837731 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:58.837970 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.838469 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.839145 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.839344 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.839431 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.841719 (+ 2288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:56249: BlockingRecv error: recv got EOF from 127.2.55.129:56249 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 16:47:58.842116 16135 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:47:58.922660 16141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:58.922878 16141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:58.922904 16141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:58.924032 16141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:58.924077 16141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:58.924103 16141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:47:58.925534 16141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.130.keytab
--principal=oryx/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:34605
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=40679
--tserver_master_addrs=127.2.55.190:37153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:58.925742 16141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:58.925923 16141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:58.931318 16148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:58.931475 16141 server_base.cc:1034] running on GCE node
W20260811 16:47:58.931356 16147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:58.931456 16150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:58.931850 16141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:58.932119 16141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:58.933317 16141 hybrid_clock.cc:648] HybridClock initialized: now 1786466878933319 us; error 49 us; skew 500 ppm
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466878, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:58.935931 16141 init.cc:377] Logged in from keytab as oryx/127.2.55.130@KRBTEST.COM (short username oryx)
I20260811 16:47:58.936388 16141 webserver.cc:460] Webserver started at http://127.2.55.130:40679/ using document root <none> and password file <none>
I20260811 16:47:58.936625 16141 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:58.936720 16141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:58.938234 16141 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:58.938968 16159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:58.939213 16141 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:58.939320 16141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "4c25954195324aea8942caf63018b456"
format_stamp: "Formatted at 2026-08-11 16:47:58 on dist-test-slave-3h5h"
server_key: "6421c322dcdecac546d736bbe8eeb711"
server_key_iv: "1808de849d4febb985a6071046a2919a"
server_key_version: "encryptionkey@0"
I20260811 16:47:58.939798 16141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:58.954597 16141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:58.956985 16141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:58.957201 16141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:58.957466 16141 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:58.957799 16141 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:58.957854 16141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:58.957896 16141 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:58.958048 16141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:58.964466 16141 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:34605
I20260811 16:47:58.964524 16337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:34605 every 8 connection(s)
I20260811 16:47:58.964968 16141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:47:58.970292 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 16141
I20260811 16:47:58.970642 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:38579
--local_ip_for_outbound_sockets=127.2.55.131
--tserver_master_addrs=127.2.55.190:37153
--webserver_port=38709
--webserver_interface=127.2.55.131
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:44417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.2.55.131
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:47:58.973690 16344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:58.965919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:56803)
0811 16:47:58.966191 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:58.966232 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:58.966762 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:58.967038 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:58.967048 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:58.967642 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:58.967840 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.967845 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.968545 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.968546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.969444 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.969447 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.969853 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.969854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.969989 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.970657 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:58.970667 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:58.973458 (+ 2791us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":97,"threads_started":1}
W20260811 16:47:58.974010 16341 heartbeater.cc:644] Failed to heartbeat to 127.2.55.190:37153 (0 consecutive failures): Not authorized: Failed to ping master at 127.2.55.190:37153: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
W20260811 16:47:58.974103 16139 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:58.965959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:56803 (local address 127.2.55.190:37153)
0811 16:47:58.966094 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:58.966097 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:58.966323 (+ 226us) server_negotiation.cc:407] Connection header received
0811 16:47:58.966885 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:58.966887 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:58.966906 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:58.966949 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:58.967944 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.968441 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.969552 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.969758 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.969844 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.974039 (+ 4195us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:56803: BlockingRecv error: recv got EOF from 127.2.55.130:56803 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:47:58.979326 16344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:58.974369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:44263)
0811 16:47:58.974412 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:58.974423 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:58.974465 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:58.974610 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:58.974610 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:58.974747 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:58.974794 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.974796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.975576 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.975577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.976126 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.976130 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.976536 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.976537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.976606 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.977145 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:58.977151 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:58.979228 (+ 2077us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 16:47:58.979391 16139 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:58.974429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:44263 (local address 127.2.55.190:37153)
0811 16:47:58.974479 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:58.974481 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:58.974508 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:47:58.974539 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:58.974540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:58.974550 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:58.974601 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:58.974874 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.975482 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.976251 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.976448 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.976534 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.979322 (+ 2788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:44263: BlockingRecv error: recv got EOF from 127.2.55.130:44263 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:47:58 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:47:58.984671 16344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:58.979678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:51649)
0811 16:47:58.979752 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:58.979766 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:58.979818 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:58.979941 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:58.979942 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:58.980098 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:58.980138 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.980140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.980792 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.980794 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.981721 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:58.981724 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.982160 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.982161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:58.982225 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.982627 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:58.982633 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:58.984586 (+ 1953us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 16:47:58.984726 16139 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:58.979799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:51649 (local address 127.2.55.190:37153)
0811 16:47:58.979837 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:58.979839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:58.979847 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:47:58.979877 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:58.979878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:58.979886 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:58.979936 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:58.980243 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.980701 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.981821 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:58.982072 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:58.982141 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:58.984661 (+ 2520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:51649: BlockingRecv error: recv got EOF from 127.2.55.130:51649 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 16:47:58.984812 16341 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:47:59.063218 16345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:59.063516 16345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:59.063576 16345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:59.065056 16345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:59.065131 16345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:59.065183 16345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:47:59.066929 16345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/krb5kdc/oryx_127.2.55.131.keytab
--principal=oryx/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:38579
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=38709
--tserver_master_addrs=127.2.55.190:37153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:59.067267 16345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:59.067554 16345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:59.073791 16357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:59.073793 16353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:59.073788 16354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:59.074416 16345 server_base.cc:1034] running on GCE node
I20260811 16:47:59.074699 16345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:59.075055 16345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:59.076282 16345 hybrid_clock.cc:648] HybridClock initialized: now 1786466879076276 us; error 51 us; skew 500 ppm
Aug 11 16:47:59 dist-test-slave-3h5h krb5kdc[15023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466879, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:59.079392 16345 init.cc:377] Logged in from keytab as oryx/127.2.55.131@KRBTEST.COM (short username oryx)
I20260811 16:47:59.079902 16345 webserver.cc:460] Webserver started at http://127.2.55.131:38709/ using document root <none> and password file <none>
I20260811 16:47:59.080202 16345 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:59.080287 16345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:59.081951 16345 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:59.082729 16367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:59.082926 16345 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:59.083099 16345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "9db075b842b8411baa0b655132f5d618"
format_stamp: "Formatted at 2026-08-11 16:47:58 on dist-test-slave-3h5h"
server_key: "64c39f526e5d9ba9f776f6d7908e8bc0"
server_key_iv: "96ddb24084efbbb640548037e5930dd5"
server_key_version: "encryptionkey@0"
I20260811 16:47:59.083506 16345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:59.099224 16345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:59.101284 16345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:59.101451 16345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:59.101706 16345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:47:59.102058 16345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:47:59.102118 16345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:59.102165 16345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:47:59.102190 16345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:59.108956 16345 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:38579
I20260811 16:47:59.109001 16528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:38579 every 8 connection(s)
I20260811 16:47:59.109365 16345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:47:59 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:47:59 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 16:47:59.117156 16139 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:59.110049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:59101 (local address 127.2.55.190:37153)
0811 16:47:59.110101 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:59.110104 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:59.110363 (+ 259us) server_negotiation.cc:407] Connection header received
0811 16:47:59.110903 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:59.110905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:59.110918 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:59.110984 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:59.112053 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.112627 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.113779 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.113974 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.114063 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:59.117101 (+ 3038us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:59101: BlockingRecv error: recv got EOF from 127.2.55.131:59101 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:47:59.117208 16531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:59.110037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:59101)
0811 16:47:59.110223 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:59.110284 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:59.110793 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:59.111061 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:59.111065 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:59.111742 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:59.111958 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:59.111963 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.112725 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.112726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:59.113651 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:59.113654 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.114075 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.114076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:59.114210 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:59.114793 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:59.114807 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:59.117010 (+ 2203us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":89,"threads_started":1}
W20260811 16:47:59.117483 16529 heartbeater.cc:644] Failed to heartbeat to 127.2.55.190:37153 (0 consecutive failures): Not authorized: Failed to ping master at 127.2.55.190:37153: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
I20260811 16:47:59.117615 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 16345
Aug 11 16:47:59 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:47:59 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:47:59.122574 16531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:59.117737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:33467)
0811 16:47:59.117784 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:59.117799 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:59.117870 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:59.118128 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:59.118129 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:59.118301 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:59.118358 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:59.118359 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.119118 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.119119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:59.119591 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:59.119593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.119965 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.119966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:59.120034 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:59.120450 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:59.120460 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:59.122506 (+ 2046us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 16:47:59.122689 16139 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:59.117913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:33467 (local address 127.2.55.190:37153)
0811 16:47:59.117973 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:59.117975 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:59.117989 (+ 14us) server_negotiation.cc:407] Connection header received
0811 16:47:59.118009 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:59.118010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:59.118038 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:59.118107 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:59.118438 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.118914 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.119676 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.119896 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.119946 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:59.122609 (+ 2663us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:33467: BlockingRecv error: recv got EOF from 127.2.55.131:33467 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:47:59.125813 16536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:59.118066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40416 (local address 127.2.55.190:37153)
0811 16:47:59.118186 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:59.118188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:59.118265 (+ 77us) server_negotiation.cc:407] Connection header received
0811 16:47:59.118336 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:59.118336 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:59.118344 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:59.118391 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:59.119096 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.119604 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.120585 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.120774 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.120999 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:59.122109 (+ 1110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:59.122114 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:59.122115 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:59.122128 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:59.124102 (+ 1974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:59.124523 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:59.124526 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:59.124527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:59.124660 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:59.124939 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:59.124940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:59.124941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:59.125247 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:59.125405 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:59.125545 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 16:47:59.125690 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":84,"threads_started":1}
Aug 11 16:47:59 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:47:59 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:47:59.127928 16531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:59.122854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:35595)
0811 16:47:59.123174 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:59.123183 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:59.123223 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:59.123414 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:59.123415 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:59.123576 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:59.123606 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:59.123607 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.124369 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.124369 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:59.125168 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:59.125171 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.125644 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.125645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:59.125701 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:59.126117 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:59.126123 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:59.127884 (+ 1761us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":303}
W20260811 16:47:59.128089 16529 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:47:59.128062 16139 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:59.122910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:35595 (local address 127.2.55.190:37153)
0811 16:47:59.122950 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:59.122952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:59.123249 (+ 297us) server_negotiation.cc:407] Connection header received
0811 16:47:59.123277 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:59.123278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:59.123289 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:59.123365 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:59.123704 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.124283 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.125259 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.125556 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.125621 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:59.127995 (+ 2374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:35595: BlockingRecv error: recv got EOF from 127.2.55.131:35595 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 11 16:47:59 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:47:59 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:47:59.847430 16537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:59.842528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:58175)
0811 16:47:59.842681 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:59.842693 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:59.842792 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:59.842960 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:59.842961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:59.843142 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:59.843203 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:59.843204 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.844036 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.844037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:59.844591 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:59.844593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.844963 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.844964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:59.845009 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:59.845502 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:59.845507 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:59.847357 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":97,"threads_started":1}
W20260811 16:47:59.847602 16538 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:59.842643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:58175 (local address 127.2.55.190:37153)
0811 16:47:59.842779 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:59.842781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:59.842789 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:47:59.842872 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:59.842873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:59.842882 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:59.842946 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:59.843321 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.843903 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.844682 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.844905 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.844960 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:59.847486 (+ 2526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:58175: BlockingRecv error: recv got EOF from 127.2.55.129:58175 (error 108)
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":64,"threads_started":1}
Aug 11 16:47:59 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:47:59 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:47:59.990669 16539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:59.985283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:43261)
0811 16:47:59.985424 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:59.985436 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:59.985538 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:59.985710 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:59.985711 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:59.985879 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:59.985931 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:59.985933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.986696 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.986698 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:59.987376 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:59.987379 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.987787 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.987788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:59.987838 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:59.988418 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:59.988425 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:59.990594 (+ 2169us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":89,"threads_started":1}
W20260811 16:47:59.990842 16538 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:59.985340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:43261 (local address 127.2.55.190:37153)
0811 16:47:59.985417 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:59.985420 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:59.985521 (+ 101us) server_negotiation.cc:407] Connection header received
0811 16:47:59.985596 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:59.985597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:59.985609 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:59.985673 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:59.986028 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.986601 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.987460 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:59.987701 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:59.987763 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:59.990757 (+ 2994us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:43261: BlockingRecv error: recv got EOF from 127.2.55.130:43261 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 16:48:00 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:00 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:00.133188 16541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:00.128512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:49673)
0811 16:48:00.128666 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:00.128691 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:00.128782 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:00.129017 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:00.129018 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:00.129199 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:00.129250 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:00.129252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:00.129901 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:00.129902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:00.130458 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:00.130461 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:00.130785 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:00.130786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:00.130825 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:00.131312 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:00.131317 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:00.133117 (+ 1800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":61,"threads_started":1}
W20260811 16:48:00.133285 16538 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:00.128621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:49673 (local address 127.2.55.190:37153)
0811 16:48:00.128727 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:00.128729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:00.128756 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:48:00.128892 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:00.128893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:00.128910 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:00.128965 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:00.129327 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:00.129821 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:00.130537 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:00.130719 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:00.130773 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:00.133218 (+ 2445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:49673: BlockingRecv error: recv got EOF from 127.2.55.131:49673 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 11 16:48:00 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:00 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:00.852950 16542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:00.847986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:43021)
0811 16:48:00.848175 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:00.848186 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:00.848248 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:00.848363 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:00.848363 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:00.848527 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:00.848576 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:00.848577 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:00.849238 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:00.849239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:00.849770 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:00.849772 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:00.850135 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:00.850136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:00.850176 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:00.850630 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:00.850635 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:00.852808 (+ 2173us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":125,"threads_started":1}
W20260811 16:48:00.853083 16543 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:00.848076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:43021 (local address 127.2.55.190:37153)
0811 16:48:00.848194 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:00.848196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:00.848259 (+ 63us) server_negotiation.cc:407] Connection header received
0811 16:48:00.848289 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:00.848290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:00.848301 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:00.848357 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:00.848637 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:00.849168 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:00.849844 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:00.850032 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:00.850081 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:00.852926 (+ 2845us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:43021: BlockingRecv error: recv got EOF from 127.2.55.129:43021 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":65,"threads_started":1}
Aug 11 16:48:00 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:00 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:00.996124 16544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:00.991218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:38913)
0811 16:48:00.991377 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:00.991388 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:00.991446 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:00.991612 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:00.991612 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:00.991781 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:00.991831 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:00.991833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:00.992565 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:00.992566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:00.993170 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:00.993173 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:00.993501 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:00.993502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:00.993543 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:00.994072 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:00.994077 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:00.996015 (+ 1938us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":91,"threads_started":1}
W20260811 16:48:00.996173 16543 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:00.991321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:38913 (local address 127.2.55.190:37153)
0811 16:48:00.991390 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:00.991392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:00.991446 (+ 54us) server_negotiation.cc:407] Connection header received
0811 16:48:00.991512 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:00.991513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:00.991525 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:00.991572 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:00.991903 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:00.992486 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:00.993248 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:00.993433 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:00.993491 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:00.996104 (+ 2613us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:38913: BlockingRecv error: recv got EOF from 127.2.55.130:38913 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 16:48:01 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:01 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:01.138438 16545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:01.133725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:58149)
0811 16:48:01.133877 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:01.133888 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:01.133967 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:01.134159 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:01.134160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:01.134338 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:01.134388 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:01.134390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:01.135061 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:01.135062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:01.135588 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:01.135589 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:01.135958 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:01.135959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:01.136022 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:01.136522 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:01.136527 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:01.138326 (+ 1799us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":63,"threads_started":1}
W20260811 16:48:01.138474 16543 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:01.133894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:58149 (local address 127.2.55.190:37153)
0811 16:48:01.133960 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:01.133962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:01.133972 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:48:01.134031 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:01.134032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:01.134048 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:01.134151 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:01.134471 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:01.134970 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:01.135678 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:01.135871 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:01.135947 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:01.138407 (+ 2460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:58149: BlockingRecv error: recv got EOF from 127.2.55.131:58149 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 16:48:01 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:01 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:01.874943 16548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:01.853523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:54395)
0811 16:48:01.853714 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:01.853734 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:01.853816 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:01.853996 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:01.853997 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:01.854177 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:01.854231 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:01.854232 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:01.854907 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:01.854908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:01.855535 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:01.855538 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:01.855931 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:01.855932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:01.855978 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:01.872347 (+ 16369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:01.872357 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:01.874835 (+ 2478us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":67,"threads_started":1}
W20260811 16:48:01.875116 16549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:01.853705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:54395 (local address 127.2.55.190:37153)
0811 16:48:01.853858 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:01.853860 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:01.853869 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:48:01.853901 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:01.853901 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:01.853912 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:01.853972 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:01.854306 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:01.854828 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:01.855652 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:01.855855 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:01.855916 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:01.874948 (+ 19032us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:54395: BlockingRecv error: recv got EOF from 127.2.55.129:54395 (error 108)
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":95,"threads_started":1}
Aug 11 16:48:01 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:01 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:02.002125 16550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:01.996762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:54841)
0811 16:48:01.996948 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:01.996959 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:01.997012 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:01.997309 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:01.997312 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:01.997579 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:01.997635 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:01.997637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:01.998344 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:01.998346 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:01.998992 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:01.998995 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:01.999421 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:01.999422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:01.999472 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:02.000014 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:02.000019 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:02.002017 (+ 1998us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":120,"threads_started":1}
W20260811 16:48:02.002177 16549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:01.996928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:54841 (local address 127.2.55.190:37153)
0811 16:48:01.996996 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:01.996998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:01.997018 (+ 20us) server_negotiation.cc:407] Connection header received
0811 16:48:01.997070 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:01.997071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:01.997169 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:01.997238 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:01.997724 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:01.998248 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:01.999127 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:01.999326 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:01.999387 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:02.002111 (+ 2724us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:54841: BlockingRecv error: recv got EOF from 127.2.55.130:54841 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 16:48:02 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:02 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:02.144618 16551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:02.139108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:45513)
0811 16:48:02.139274 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:02.139289 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:02.139367 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:02.139523 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:02.139523 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:02.139698 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:02.139747 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:02.139749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:02.140536 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:02.140538 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:02.141203 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:02.141206 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:02.141634 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:02.141636 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:02.141692 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:02.142277 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:02.142282 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:02.144533 (+ 2251us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":82,"threads_started":1}
W20260811 16:48:02.144767 16549 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:02.139259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:45513 (local address 127.2.55.190:37153)
0811 16:48:02.139358 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:02.139360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:02.139372 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:48:02.139421 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:02.139422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:02.139438 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:02.139499 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:02.139811 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:02.140453 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:02.141347 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:02.141544 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:02.141604 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:02.144672 (+ 3068us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:45513: BlockingRecv error: recv got EOF from 127.2.55.131:45513 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 16:48:02 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:02 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:02.881248 16553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:02.875600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:42345)
0811 16:48:02.875762 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:02.875779 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:02.875844 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:02.876114 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:02.876116 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:02.876299 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:02.876354 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:02.876355 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:02.877199 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:02.877200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:02.877798 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:02.877800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:02.878380 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:02.878381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:02.878455 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:02.879329 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:02.879334 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:02.881188 (+ 1854us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":97,"threads_started":1}
W20260811 16:48:02.881385 16554 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:02.875628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:42345 (local address 127.2.55.190:37153)
0811 16:48:02.875774 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:02.875776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:02.875863 (+ 87us) server_negotiation.cc:407] Connection header received
0811 16:48:02.875893 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:02.875894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:02.875906 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:02.875977 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:02.876468 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:02.877032 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:02.877917 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:02.878270 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:02.878346 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:02.881292 (+ 2946us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:42345: BlockingRecv error: recv got EOF from 127.2.55.129:42345 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":77,"threads_started":1}
Aug 11 16:48:03 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:03 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:03.007809 16556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:03.002770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:44915)
0811 16:48:03.002983 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:03.002998 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:03.003083 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:03.003257 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:03.003258 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:03.003430 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:03.003501 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:03.003503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:03.004274 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:03.004276 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:03.004807 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:03.004808 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:03.005297 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:03.005298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:03.005355 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:03.005802 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:03.005806 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:03.007749 (+ 1943us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":88,"threads_started":1}
W20260811 16:48:03.007956 16554 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:03.002858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:44915 (local address 127.2.55.190:37153)
0811 16:48:03.002978 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:03.002980 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:03.003117 (+ 137us) server_negotiation.cc:407] Connection header received
0811 16:48:03.003149 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:03.003150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:03.003172 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:03.003235 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:03.003586 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:03.004165 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:03.005002 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:03.005225 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:03.005285 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:03.007857 (+ 2572us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:44915: BlockingRecv error: recv got EOF from 127.2.55.130:44915 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 11 16:48:03 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:03 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:03.150209 16558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:03.145126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:49177)
0811 16:48:03.145308 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:03.145318 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:03.145432 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:03.145633 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:03.145635 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:03.145818 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:03.145870 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:03.145872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:03.146552 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:03.146554 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:03.147086 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:03.147087 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:03.147449 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:03.147450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:03.147513 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:03.147981 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:03.147985 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:03.150141 (+ 2156us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":106,"threads_started":1}
W20260811 16:48:03.150331 16554 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:03.145193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:49177 (local address 127.2.55.190:37153)
0811 16:48:03.145287 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:03.145290 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:03.145411 (+ 121us) server_negotiation.cc:407] Connection header received
0811 16:48:03.145509 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:03.145510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:03.145528 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:03.145610 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:03.145950 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:03.146458 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:03.147182 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:03.147374 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:03.147449 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:03.150233 (+ 2784us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:49177: BlockingRecv error: recv got EOF from 127.2.55.131:49177 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 16:48:03 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:03 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:03.887454 16559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:03.881939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:55755)
0811 16:48:03.882111 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:03.882125 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:03.882190 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:03.882398 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:03.882400 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:03.882616 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:03.882688 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:03.882690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:03.883393 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:03.883394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:03.884033 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:03.884036 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:03.884412 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:03.884413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:03.884467 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:03.885230 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:03.885235 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:03.887361 (+ 2126us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":117,"threads_started":1}
W20260811 16:48:03.887570 16560 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:03.882031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:55755 (local address 127.2.55.190:37153)
0811 16:48:03.882206 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:03.882208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:03.882218 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:48:03.882263 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:03.882264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:03.882275 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:03.882347 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:03.882789 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:03.883303 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:03.884123 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:03.884331 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:03.884383 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:03.887443 (+ 3060us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:55755: BlockingRecv error: recv got EOF from 127.2.55.129:55755 (error 108)
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":96,"threads_started":1}
Aug 11 16:48:04 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:04 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:04.013644 16561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:04.008559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:53451)
0811 16:48:04.008780 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:04.008793 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:04.008889 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:04.009123 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:04.009124 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:04.009320 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:04.009372 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:04.009374 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:04.010092 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:04.010093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:04.010626 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:04.010628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:04.011010 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:04.011011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:04.011172 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:04.011658 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:04.011663 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:04.013567 (+ 1904us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":121,"threads_started":1}
W20260811 16:48:04.013787 16560 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:04.008731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:53451 (local address 127.2.55.190:37153)
0811 16:48:04.008841 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:04.008845 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:04.008876 (+ 31us) server_negotiation.cc:407] Connection header received
0811 16:48:04.008977 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:04.008978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:04.008995 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:04.009113 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:04.009477 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:04.009995 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:04.010726 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:04.010919 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:04.010991 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:04.013670 (+ 2679us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:53451: BlockingRecv error: recv got EOF from 127.2.55.130:53451 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 16:48:04 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:04 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:04.155561 16562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:04.150751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:41393)
0811 16:48:04.150911 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:04.150929 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:04.151018 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:04.151196 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:04.151197 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:04.151418 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:04.151481 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:04.151483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:04.152231 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:04.152232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:04.152750 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:04.152751 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:04.153167 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:04.153168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:04.153210 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:04.153707 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:04.153712 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:04.155501 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":105,"threads_started":1}
W20260811 16:48:04.155716 16560 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:04.150875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:41393 (local address 127.2.55.190:37153)
0811 16:48:04.150944 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:04.150947 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:04.151013 (+ 66us) server_negotiation.cc:407] Connection header received
0811 16:48:04.151085 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:04.151086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:04.151105 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:04.151187 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:04.151567 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:04.152148 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:04.152855 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:04.153087 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:04.153160 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:04.155638 (+ 2478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:41393: BlockingRecv error: recv got EOF from 127.2.55.131:41393 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 16:48:04 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:04 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:04.892741 16563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:04.887967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:33499)
0811 16:48:04.888176 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:04.888188 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:04.888258 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:04.888403 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:04.888404 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:04.888572 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:04.888627 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:04.888629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:04.889335 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:04.889335 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:04.889858 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:04.889859 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:04.890217 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:04.890218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:04.890260 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:04.890717 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:04.890721 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:04.892682 (+ 1961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":80,"threads_started":1}
W20260811 16:48:04.893007 16564 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:04.888036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:33499 (local address 127.2.55.190:37153)
0811 16:48:04.888205 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:04.888207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:04.888242 (+ 35us) server_negotiation.cc:407] Connection header received
0811 16:48:04.888316 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:04.888317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:04.888328 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:04.888385 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:04.888697 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:04.889265 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:04.889931 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:04.890149 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:04.890202 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:04.892784 (+ 2582us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:33499: BlockingRecv error: recv got EOF from 127.2.55.129:33499 (error 108)
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":84,"threads_started":1}
Aug 11 16:48:05 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:05 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:05.019371 16565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:05.014180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:35847)
0811 16:48:05.014348 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:05.014359 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:05.014421 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:05.014567 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:05.014568 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:05.014763 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:05.014815 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:05.014817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:05.015475 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:05.015476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:05.016150 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:05.016153 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:05.016511 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:05.016512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:05.016556 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:05.017043 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:05.017048 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:05.019271 (+ 2223us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":86,"threads_started":1}
W20260811 16:48:05.019415 16564 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:05.014269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:35847 (local address 127.2.55.190:37153)
0811 16:48:05.014344 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:05.014346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:05.014423 (+ 77us) server_negotiation.cc:407] Connection header received
0811 16:48:05.014470 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:05.014471 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:05.014482 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:05.014540 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:05.014882 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:05.015376 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:05.016240 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:05.016428 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:05.016480 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:05.019351 (+ 2871us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:35847: BlockingRecv error: recv got EOF from 127.2.55.130:35847 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 16:48:05 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:05 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:05.161108 16567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:05.156199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:51323)
0811 16:48:05.156426 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:05.156443 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:05.156520 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:05.156676 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:05.156677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:05.156873 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:05.156924 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:05.156926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:05.157575 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:05.157576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:05.158091 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:05.158092 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:05.158415 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:05.158415 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:05.158452 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:05.158960 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:05.158965 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:05.161042 (+ 2077us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":98,"threads_started":1}
W20260811 16:48:05.161242 16564 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:05.156413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:51323 (local address 127.2.55.190:37153)
0811 16:48:05.156502 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:05.156504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:05.156514 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:48:05.156590 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:05.156590 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:05.156605 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:05.156648 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:05.156976 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:05.157504 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:05.158166 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:05.158349 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:05.158402 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:05.161128 (+ 2726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:51323: BlockingRecv error: recv got EOF from 127.2.55.131:51323 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 11 16:48:05 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:05 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:05.898552 16568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:05.893378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:49083)
0811 16:48:05.893623 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:05.893637 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:05.893755 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:05.893952 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:05.893953 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:05.894182 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:05.894236 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:05.894238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:05.894939 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:05.894941 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:05.895470 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:05.895471 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:05.895864 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:05.895865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:05.895930 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:05.896420 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:05.896425 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:05.898452 (+ 2027us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":77,"threads_started":1}
W20260811 16:48:05.898612 16569 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:05.893496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:49083 (local address 127.2.55.190:37153)
0811 16:48:05.893629 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:05.893632 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:05.893734 (+ 102us) server_negotiation.cc:407] Connection header received
0811 16:48:05.893837 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:05.893838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:05.893852 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:05.893946 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:05.894328 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:05.894851 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:05.895559 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:05.895772 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:05.895860 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:05.898542 (+ 2682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:49083: BlockingRecv error: recv got EOF from 127.2.55.129:49083 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":65,"threads_started":1}
Aug 11 16:48:06 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:06 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:06.024863 16570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:06.019900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:39247)
0811 16:48:06.020039 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:06.020053 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:06.020174 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:06.020308 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:06.020309 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:06.020477 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:06.020529 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:06.020531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:06.021271 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:06.021272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:06.021810 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:06.021811 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:06.022156 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:06.022157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:06.022195 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:06.022687 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:06.022692 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:06.024783 (+ 2091us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":61,"threads_started":1}
W20260811 16:48:06.025027 16569 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:06.020012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:39247 (local address 127.2.55.190:37153)
0811 16:48:06.020098 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:06.020100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:06.020155 (+ 55us) server_negotiation.cc:407] Connection header received
0811 16:48:06.020224 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:06.020225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:06.020236 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:06.020286 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:06.020594 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:06.021193 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:06.021878 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:06.022059 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:06.022148 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:06.024954 (+ 2806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:39247: BlockingRecv error: recv got EOF from 127.2.55.130:39247 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 16:48:06 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:06 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:06.166656 16575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:06.161741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:44737)
0811 16:48:06.161914 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:06.161934 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:06.162010 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:06.162218 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:06.162219 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:06.162459 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:06.162509 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:06.162511 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:06.163194 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:06.163195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:06.163729 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:06.163730 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:06.164123 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:06.164124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:06.164185 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:06.164708 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:06.164714 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:06.166553 (+ 1839us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":117,"threads_started":1}
W20260811 16:48:06.166707 16569 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:06.161792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:44737 (local address 127.2.55.190:37153)
0811 16:48:06.161891 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:06.161893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:06.162010 (+ 117us) server_negotiation.cc:407] Connection header received
0811 16:48:06.162127 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:06.162128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:06.162144 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:06.162207 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:06.162599 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:06.163104 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:06.163832 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:06.164035 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:06.164110 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:06.166639 (+ 2529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:44737: BlockingRecv error: recv got EOF from 127.2.55.131:44737 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 11 16:48:06 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:06 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:06.909766 16577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:06.899070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:48661)
0811 16:48:06.899295 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:06.899308 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:06.899374 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:06.899578 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:06.899579 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:06.899771 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:06.899823 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:06.899825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:06.900561 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:06.900562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:06.901147 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:06.901150 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:06.901509 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:06.901510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:06.901550 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:06.907408 (+ 5858us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:06.907415 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:06.909693 (+ 2278us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":124,"threads_started":1}
W20260811 16:48:06.909971 16578 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:06.899234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:48661 (local address 127.2.55.190:37153)
0811 16:48:06.899397 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:06.899399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:06.899409 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:48:06.899437 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:06.899438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:06.899452 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:06.899563 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:06.899934 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:06.900481 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:06.901240 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:06.901439 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:06.901502 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:06.909884 (+ 8382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:48661: BlockingRecv error: recv got EOF from 127.2.55.129:48661 (error 108)
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":65,"threads_started":1}
Aug 11 16:48:07 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:07 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:07.030483 16581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:07.025366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:38019)
0811 16:48:07.025560 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:07.025572 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:07.025645 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:07.025791 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:07.025792 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:07.025960 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:07.026007 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:07.026008 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:07.026810 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:07.026811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:07.027404 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:07.027407 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:07.027858 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:07.027859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:07.027910 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:07.028391 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:07.028397 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:07.030422 (+ 2025us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":128,"threads_started":1}
W20260811 16:48:07.030661 16578 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:07.025461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:38019 (local address 127.2.55.190:37153)
0811 16:48:07.025535 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:07.025537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:07.025646 (+ 109us) server_negotiation.cc:407] Connection header received
0811 16:48:07.025706 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:07.025707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:07.025721 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:07.025763 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:07.026071 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:07.026716 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:07.027522 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:07.027757 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:07.027829 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:07.030552 (+ 2723us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:38019: BlockingRecv error: recv got EOF from 127.2.55.130:38019 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 16:48:07 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:07 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:07.172711 16583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:07.167420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:42667)
0811 16:48:07.167696 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:07.167710 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:07.167789 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:07.168023 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:07.168024 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:07.168264 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:07.168327 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:07.168329 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:07.169101 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:07.169102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:07.169637 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:07.169639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:07.170052 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:07.170053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:07.170110 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:07.170645 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:07.170651 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:07.172650 (+ 1999us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":113,"threads_started":1}
W20260811 16:48:07.172837 16578 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:07.167547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:42667 (local address 127.2.55.190:37153)
0811 16:48:07.167627 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:07.167634 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:07.167787 (+ 153us) server_negotiation.cc:407] Connection header received
0811 16:48:07.167882 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:07.167882 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:07.167896 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:07.167979 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:07.168414 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:07.169024 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:07.169743 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:07.169947 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:07.170022 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:07.172756 (+ 2734us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:42667: BlockingRecv error: recv got EOF from 127.2.55.131:42667 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 11 16:48:07 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:07 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:07.915511 16584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:07.910257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:55183)
0811 16:48:07.910398 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:07.910410 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:07.910461 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:07.910660 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:07.910661 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:07.910841 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:07.910893 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:07.910894 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:07.911783 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:07.911784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:07.912447 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:07.912450 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:07.912898 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:07.912899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:07.912947 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:07.913475 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:07.913480 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:07.915433 (+ 1953us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":82,"threads_started":1}
W20260811 16:48:07.915661 16586 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:07.910361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:55183 (local address 127.2.55.190:37153)
0811 16:48:07.910489 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:07.910491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:07.910499 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:48:07.910532 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:07.910532 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:07.910543 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:07.910618 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:07.910993 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:07.911710 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:07.912518 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:07.912788 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:07.912864 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:07.915563 (+ 2699us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:55183: BlockingRecv error: recv got EOF from 127.2.55.129:55183 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":78,"threads_started":1}
Aug 11 16:48:08 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:08 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:08.036141 16589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:08.031130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:50969)
0811 16:48:08.031333 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:08.031348 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:08.031447 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:08.031612 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:08.031613 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:08.031804 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:08.031855 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:08.031858 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:08.032621 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:08.032623 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:08.033178 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:08.033180 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:08.033556 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:08.033557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:08.033615 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:08.034093 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:08.034098 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:08.036046 (+ 1948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":102,"threads_started":1}
W20260811 16:48:08.036217 16586 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:08.031249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:50969 (local address 127.2.55.190:37153)
0811 16:48:08.031338 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:08.031341 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:08.031427 (+ 86us) server_negotiation.cc:407] Connection header received
0811 16:48:08.031530 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:08.031531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:08.031545 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:08.031604 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:08.031940 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:08.032529 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:08.033278 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:08.033479 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:08.033558 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:08.036152 (+ 2594us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:50969: BlockingRecv error: recv got EOF from 127.2.55.130:50969 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 16:48:08 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:08 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:08.178388 16590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:08.173242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:38267)
0811 16:48:08.173428 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:08.173443 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:08.173535 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:08.173685 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:08.173685 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:08.173887 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:08.173935 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:08.173937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:08.174728 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:08.174729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:08.175278 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:08.175280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:08.175682 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:08.175683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:08.175750 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:08.176227 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:08.176233 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:08.178318 (+ 2085us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":107,"threads_started":1}
W20260811 16:48:08.178563 16586 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:08.173349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:38267 (local address 127.2.55.190:37153)
0811 16:48:08.173432 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:08.173434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:08.173512 (+ 78us) server_negotiation.cc:407] Connection header received
0811 16:48:08.173609 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:08.173610 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:08.173626 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:08.173680 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:08.174021 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:08.174626 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:08.175368 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:08.175588 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:08.175679 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:08.178462 (+ 2783us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:38267: BlockingRecv error: recv got EOF from 127.2.55.131:38267 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 16:48:08 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:08 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:08.921190 16591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:08.916227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:60209)
0811 16:48:08.916383 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:08.916396 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:08.916449 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:08.916626 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:08.916627 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:08.916807 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:08.916891 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:08.916893 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:08.917542 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:08.917542 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:08.918151 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:08.918153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:08.918518 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:08.918519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:08.918563 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:08.919160 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:08.919165 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:08.921125 (+ 1960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":87,"threads_started":1}
W20260811 16:48:08.921321 16593 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:08.916351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:60209 (local address 127.2.55.190:37153)
0811 16:48:08.916489 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:08.916491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:08.916499 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:48:08.916521 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:08.916522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:08.916533 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:08.916601 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:08.916957 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:08.917463 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:08.918235 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:08.918447 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:08.918502 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:08.921233 (+ 2731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:60209: BlockingRecv error: recv got EOF from 127.2.55.129:60209 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":80,"threads_started":1}
Aug 11 16:48:09 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:09 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:09.041997 16594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:09.036685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:40077)
0811 16:48:09.036880 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:09.036893 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:09.036963 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:09.037111 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:09.037112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:09.037298 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:09.037349 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:09.037350 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:09.038096 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:09.038098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:09.038656 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:09.038658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:09.039220 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:09.039222 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:09.039274 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:09.039859 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:09.039865 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:09.041860 (+ 1995us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":117,"threads_started":1}
W20260811 16:48:09.042146 16593 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:09.036741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:40077 (local address 127.2.55.190:37153)
0811 16:48:09.036795 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:09.036797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:09.036954 (+ 157us) server_negotiation.cc:407] Connection header received
0811 16:48:09.037014 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:09.037015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:09.037027 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:09.037087 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:09.037455 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:09.037970 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:09.038751 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:09.038950 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:09.039017 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:09.042059 (+ 3042us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:40077: BlockingRecv error: recv got EOF from 127.2.55.130:40077 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 11 16:48:09 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:09 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:09.184288 16595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:09.178946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:46167)
0811 16:48:09.179153 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:09.179168 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:09.179245 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:09.179450 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:09.179451 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:09.179654 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:09.179704 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:09.179706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:09.180433 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:09.180434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:09.181005 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:09.181007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:09.181392 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:09.181392 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:09.181460 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:09.182076 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:09.182082 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:09.184175 (+ 2093us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":74,"threads_started":1}
W20260811 16:48:09.184351 16593 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:09.179067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:46167 (local address 127.2.55.190:37153)
0811 16:48:09.179183 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:09.179186 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:09.179224 (+ 38us) server_negotiation.cc:407] Connection header received
0811 16:48:09.179343 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:09.179344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:09.179360 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:09.179439 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:09.179792 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:09.180325 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:09.181095 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:09.181300 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:09.181389 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:09.184275 (+ 2886us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:46167: BlockingRecv error: recv got EOF from 127.2.55.131:46167 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
Aug 11 16:48:09 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:09 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:09.926380 16599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:09.921737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:57327)
0811 16:48:09.921904 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:09.921915 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:09.921969 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:09.922139 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:09.922140 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:09.922312 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:09.922362 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:09.922364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:09.923014 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:09.923015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:09.923576 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:09.923577 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:09.923935 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:09.923935 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:09.923978 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:09.924471 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:09.924476 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:09.926307 (+ 1831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":86,"threads_started":1}
W20260811 16:48:09.926491 16600 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:09.921845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:57327 (local address 127.2.55.190:37153)
0811 16:48:09.921982 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:09.921986 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:09.921997 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:48:09.922025 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:09.922026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:09.922040 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:09.922109 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:09.922433 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:09.922942 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:09.923665 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:09.923866 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:09.923923 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:09.926411 (+ 2488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:57327: BlockingRecv error: recv got EOF from 127.2.55.129:57327 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":82,"threads_started":1}
Aug 11 16:48:10 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:10 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:10.047399 16601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:10.042554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:50655)
0811 16:48:10.042697 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:10.042718 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:10.042781 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:10.042918 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:10.042919 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:10.043099 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:10.043146 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:10.043148 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:10.043925 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:10.043926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:10.044453 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:10.044454 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:10.044817 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:10.044818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:10.044939 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:10.045462 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:10.045467 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:10.047329 (+ 1862us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
W20260811 16:48:10.047534 16600 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:10.042654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:50655 (local address 127.2.55.190:37153)
0811 16:48:10.042737 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:10.042739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:10.042765 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:48:10.042843 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:10.042844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:10.042856 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:10.042906 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:10.043206 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:10.043846 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:10.044530 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:10.044747 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:10.044802 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:10.047443 (+ 2641us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:50655: BlockingRecv error: recv got EOF from 127.2.55.130:50655 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 16:48:10 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:10 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:10.190081 16604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:10.184951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:33563)
0811 16:48:10.185079 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:10.185126 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:10.185182 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:10.185347 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:10.185348 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:10.185524 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:10.185574 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:10.185575 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:10.186289 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:10.186290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:10.186836 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:10.186837 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:10.187211 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:10.187212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:10.187282 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:10.187766 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:10.187772 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:10.190003 (+ 2231us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":72,"threads_started":1}
W20260811 16:48:10.190332 16600 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:10.185035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:33563 (local address 127.2.55.190:37153)
0811 16:48:10.185166 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:10.185168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:10.185231 (+ 63us) server_negotiation.cc:407] Connection header received
0811 16:48:10.185256 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:10.185256 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:10.185272 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:10.185323 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:10.185681 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:10.186199 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:10.186915 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:10.187105 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:10.187194 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:10.190251 (+ 3057us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:33563: BlockingRecv error: recv got EOF from 127.2.55.131:33563 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Aug 11 16:48:10 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:10 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:10.931944 16606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:10.926952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:49673)
0811 16:48:10.927149 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:10.927161 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:10.927215 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:10.927375 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:10.927376 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:10.927555 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:10.927611 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:10.927613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:10.928444 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:10.928445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:10.929104 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:10.929108 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:10.929506 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:10.929508 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:10.929577 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:10.930034 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:10.930040 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:10.931878 (+ 1838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":96,"threads_started":1}
W20260811 16:48:10.932104 16607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:10.927049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:49673 (local address 127.2.55.190:37153)
0811 16:48:10.927194 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:10.927196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:10.927206 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:48:10.927274 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:10.927274 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:10.927285 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:10.927355 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:10.927678 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:10.928359 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:10.929205 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:10.929415 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:10.929492 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:10.932006 (+ 2514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:49673: BlockingRecv error: recv got EOF from 127.2.55.129:49673 (error 108)
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":89,"threads_started":1}
Aug 11 16:48:11 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:11 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:11.052960 16608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:11.048030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:45337)
0811 16:48:11.048212 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:11.048223 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:11.048294 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:11.048419 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:11.048420 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:11.048719 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:11.048774 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:11.048777 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:11.049508 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:11.049510 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:11.050065 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:11.050067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:11.050459 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:11.050460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:11.050519 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:11.050969 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:11.050974 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:11.052832 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":116,"threads_started":1}
W20260811 16:48:11.053020 16607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:11.048120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:45337 (local address 127.2.55.190:37153)
0811 16:48:11.048195 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:11.048197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:11.048291 (+ 94us) server_negotiation.cc:407] Connection header received
0811 16:48:11.048345 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:11.048346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:11.048359 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:11.048407 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:11.048885 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:11.049413 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:11.050162 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:11.050380 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:11.050460 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:11.052954 (+ 2494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:45337: BlockingRecv error: recv got EOF from 127.2.55.130:45337 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 16:48:11 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:11 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:11.196358 16609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:11.190779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:60417)
0811 16:48:11.190947 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:11.190961 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:11.191092 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:11.191476 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:11.191477 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:11.191694 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:11.191753 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:11.191756 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:11.192534 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:11.192536 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:11.193169 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:11.193171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:11.193592 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:11.193593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:11.193673 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:11.194256 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:11.194262 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:11.196233 (+ 1971us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":112,"threads_started":1}
W20260811 16:48:11.196414 16607 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:11.190845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:60417 (local address 127.2.55.190:37153)
0811 16:48:11.190920 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:11.190923 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:11.191086 (+ 163us) server_negotiation.cc:407] Connection header received
0811 16:48:11.191222 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:11.191223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:11.191242 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:11.191302 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:11.191848 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:11.192425 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:11.193266 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:11.193492 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:11.193590 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:11.196323 (+ 2733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:60417: BlockingRecv error: recv got EOF from 127.2.55.131:60417 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 16:48:11 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:11 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:11.942391 16610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:11.932487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:48563)
0811 16:48:11.932699 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:11.932710 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:11.932777 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:11.933017 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:11.933018 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:11.933194 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:11.933242 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:11.933244 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:11.933945 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:11.933946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:11.934564 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:11.934566 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:11.934931 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:11.934932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:11.935019 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:11.939950 (+ 4931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:11.939956 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:11.942257 (+ 2301us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":132,"threads_started":1}
W20260811 16:48:11.942468 16612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:11.932598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:48563 (local address 127.2.55.190:37153)
0811 16:48:11.932705 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:11.932708 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:11.932785 (+ 77us) server_negotiation.cc:407] Connection header received
0811 16:48:11.932903 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:11.932904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:11.932917 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:11.932991 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:11.933315 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:11.933855 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:11.934652 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:11.934854 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:11.934912 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:11.942378 (+ 7466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:48563: BlockingRecv error: recv got EOF from 127.2.55.129:48563 (error 108)
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":53,"threads_started":1}
Aug 11 16:48:12 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:12 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:12.058423 16614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:12.053526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:37829)
0811 16:48:12.053707 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:12.053720 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:12.053784 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:12.054058 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:12.054059 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:12.054256 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:12.054306 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:12.054308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:12.054976 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:12.054976 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:12.055515 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:12.055516 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:12.055862 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:12.055863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:12.055909 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:12.056382 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:12.056386 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:12.058349 (+ 1963us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":64,"threads_started":1}
W20260811 16:48:12.058528 16612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:12.053664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:37829 (local address 127.2.55.190:37153)
0811 16:48:12.053755 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:12.053757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:12.053776 (+ 19us) server_negotiation.cc:407] Connection header received
0811 16:48:12.053897 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:12.053898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:12.053910 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:12.053966 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:12.054393 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:12.054902 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:12.055598 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:12.055790 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:12.055845 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:12.058456 (+ 2611us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:37829: BlockingRecv error: recv got EOF from 127.2.55.130:37829 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 11 16:48:12 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:12 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:12.202093 16615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:12.196970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:39743)
0811 16:48:12.197157 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:12.197169 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:12.197229 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:12.197377 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:12.197378 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:12.197549 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:12.197602 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:12.197603 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:12.198296 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:12.198298 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:12.198878 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:12.198881 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:12.199285 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:12.199286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:12.199344 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:12.199861 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:12.199867 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:12.201971 (+ 2104us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":76,"threads_started":1}
W20260811 16:48:12.202121 16612 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:12.197159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:39743 (local address 127.2.55.190:37153)
0811 16:48:12.197229 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:12.197231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:12.197268 (+ 37us) server_negotiation.cc:407] Connection header received
0811 16:48:12.197301 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:12.197301 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:12.197314 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:12.197355 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:12.197665 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:12.198193 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:12.198969 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:12.199187 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:12.199248 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:12.202061 (+ 2813us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:39743: BlockingRecv error: recv got EOF from 127.2.55.131:39743 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 16:48:12 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:12 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:12.948586 16616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:12.943003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:56137)
0811 16:48:12.943164 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:12.943176 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:12.943235 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:12.943392 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:12.943394 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:12.943595 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:12.943644 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:12.943646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:12.944379 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:12.944380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:12.945186 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:12.945191 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:12.945556 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:12.945557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:12.945605 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:12.946261 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:12.946268 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:12.948503 (+ 2235us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":93,"threads_started":1}
W20260811 16:48:12.948709 16617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:12.943100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:56137 (local address 127.2.55.190:37153)
0811 16:48:12.943217 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:12.943219 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:12.943229 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:48:12.943295 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:12.943295 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:12.943306 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:12.943356 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:12.943724 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:12.944269 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:12.945283 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:12.945477 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:12.945533 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:12.948624 (+ 3091us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:56137: BlockingRecv error: recv got EOF from 127.2.55.129:56137 (error 108)
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":56,"threads_started":1}
Aug 11 16:48:13 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:13 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:13.064213 16618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:13.059011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:55821)
0811 16:48:13.059179 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:13.059199 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:13.059254 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:13.059413 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:13.059414 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:13.059610 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:13.059659 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:13.059661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:13.060354 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:13.060355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:13.060988 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:13.060990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:13.061358 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:13.061359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:13.061402 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:13.062063 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:13.062069 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:13.064123 (+ 2054us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":101,"threads_started":1}
W20260811 16:48:13.064280 16617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:13.059151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:55821 (local address 127.2.55.190:37153)
0811 16:48:13.059221 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:13.059223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:13.059237 (+ 14us) server_negotiation.cc:407] Connection header received
0811 16:48:13.059318 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:13.059319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:13.059332 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:13.059391 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:13.059729 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:13.060266 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:13.061072 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:13.061282 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:13.061345 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:13.064226 (+ 2881us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:55821: BlockingRecv error: recv got EOF from 127.2.55.130:55821 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 16:48:13 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:13 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.131@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:13.208037 16619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:13.202708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.131:41699)
0811 16:48:13.202923 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:13.202935 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:13.203002 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:13.203146 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:13.203147 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:13.203323 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:13.203372 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:13.203373 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:13.204113 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:13.204114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:13.204723 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:13.204725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:13.205215 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:13.205216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:13.205257 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:13.205811 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:13.205817 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:13.207963 (+ 2146us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":130,"threads_started":1}
W20260811 16:48:13.208276 16617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:13.202785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:41699 (local address 127.2.55.190:37153)
0811 16:48:13.202868 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:13.202871 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:13.203002 (+ 131us) server_negotiation.cc:407] Connection header received
0811 16:48:13.203051 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:13.203052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:13.203067 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:13.203132 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:13.203443 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:13.204019 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:13.204804 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:13.205133 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:13.205199 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:13.208202 (+ 3003us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.131:41699: BlockingRecv error: recv got EOF from 127.2.55.131:41699 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 16:48:13 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:13 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.129@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:13.954254 16620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:13.949172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.129:48873)
0811 16:48:13.949333 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:13.949348 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:13.949413 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:13.949551 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:13.949552 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:13.949759 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:13.949812 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:13.949814 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:13.950523 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:13.950524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:13.951102 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:13.951106 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:13.951569 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:13.951570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:13.951662 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:13.952278 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:13.952283 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:13.954191 (+ 1908us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":79,"threads_started":1}
W20260811 16:48:13.954546 16621 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:13.949258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:48873 (local address 127.2.55.190:37153)
0811 16:48:13.949409 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:13.949411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:13.949420 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:48:13.949461 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:13.949462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:13.949473 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:13.949530 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:13.949881 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:13.950425 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:13.951228 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:13.951437 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:13.951504 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:13.954320 (+ 2816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.129:48873: BlockingRecv error: recv got EOF from 127.2.55.129:48873 (error 108)
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":72,"threads_started":1}
Aug 11 16:48:14 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:48:14 dist-test-slave-3h5h krb5kdc[15023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.55.130@KRBTEST.COM for oryx/127.2.55.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:48:14.070149 16623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:14.064997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:37153 (local address 127.2.55.130:34065)
0811 16:48:14.065219 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:14.065231 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:14.065331 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:14.065520 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:14.065521 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:14.065715 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:14.065764 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:14.065767 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.066458 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.066459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:14.066982 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:14.066984 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.067365 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.067366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:14.067431 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:14.067961 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:14.067966 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:14.070002 (+ 2036us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.55.190:37153: Server oryx/127.2.55.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":111,"threads_started":1}
W20260811 16:48:14.070150 16621 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:14.065124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:34065 (local address 127.2.55.190:37153)
0811 16:48:14.065211 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:14.065214 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:14.065309 (+ 95us) server_negotiation.cc:407] Connection header received
0811 16:48:14.065416 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:14.065417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:14.065432 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:14.065510 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:14.065853 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.066362 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.067074 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.067274 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.067364 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:14.070097 (+ 2733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.55.130:34065: BlockingRecv error: recv got EOF from 127.2.55.130:34065 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 16:48:14.122403 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 15917
I20260811 16:48:14.138463 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 16141
I20260811 16:48:14.159807 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 16345
I20260811 16:48:14.174201 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 15817
2026-08-11T16:48:14Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17890 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T16:48:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:48:14Z Disabled control of system clock
I20260811 16:48:14.208058 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:38557
--webserver_interface=127.2.55.190
--webserver_port=0
--builtin_ntp_servers=127.2.55.148:44429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:38557
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 16:48:14.307163 16632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:48:14.307420 16632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:48:14.307482 16632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:48:14.308748 16632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:48:14.308825 16632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:48:14.308845 16632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:48:14.308905 16632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:48:14.308933 16632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:48:14.311141 16632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:38557
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:38557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:48:14.311446 16632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:48:14.311867 16632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:48:14.317600 16638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:14.317704 16643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:14.317631 16640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:48:14.318063 16632 server_base.cc:1034] running on GCE node
I20260811 16:48:14.318358 16632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:48:14.318799 16632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:48:14.320016 16632 hybrid_clock.cc:648] HybridClock initialized: now 1786466894319971 us; error 46 us; skew 500 ppm
I20260811 16:48:14.324242 16632 webserver.cc:460] Webserver started at http://127.2.55.190:33799/ using document root <none> and password file <none>
I20260811 16:48:14.324571 16632 fs_manager.cc:359] Metadata directory not provided
I20260811 16:48:14.324645 16632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:48:14.324795 16632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:48:14.326166 16632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "236f298af13f403d86bb159d104846f6"
format_stamp: "Formatted at 2026-08-11 16:48:14 on dist-test-slave-3h5h"
server_key: "ea22ec518c5d478f08fe890ca4c3a3d7"
server_key_iv: "f6be7486507c63fbc29a0909f085b5d1"
server_key_version: "encryptionkey@0"
I20260811 16:48:14.326627 16632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "236f298af13f403d86bb159d104846f6"
format_stamp: "Formatted at 2026-08-11 16:48:14 on dist-test-slave-3h5h"
server_key: "ea22ec518c5d478f08fe890ca4c3a3d7"
server_key_iv: "f6be7486507c63fbc29a0909f085b5d1"
server_key_version: "encryptionkey@0"
I20260811 16:48:14.328543 16632 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 16:48:14.329640 16650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:14.329841 16632 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:48:14.329952 16632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "236f298af13f403d86bb159d104846f6"
format_stamp: "Formatted at 2026-08-11 16:48:14 on dist-test-slave-3h5h"
server_key: "ea22ec518c5d478f08fe890ca4c3a3d7"
server_key_iv: "f6be7486507c63fbc29a0909f085b5d1"
server_key_version: "encryptionkey@0"
I20260811 16:48:14.330049 16632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:48:14.351886 16632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:48:14.352226 16632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:48:14.352349 16632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:48:14.356933 16632 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:38557
I20260811 16:48:14.357091 16729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:38557 every 8 connection(s)
I20260811 16:48:14.357394 16632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:48:14.358126 16730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:48:14.361042 16730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6: Bootstrap starting.
I20260811 16:48:14.361678 16730 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6: Neither blocks nor log segments found. Creating new log.
I20260811 16:48:14.361999 16730 log.cc:824] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6: Log is configured to *not* fsync() on all Append() calls
I20260811 16:48:14.362782 16730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6: No bootstrap required, opened a new log
I20260811 16:48:14.364400 16730 raft_consensus.cc:348] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "236f298af13f403d86bb159d104846f6" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 38557 } }
I20260811 16:48:14.364542 16730 raft_consensus.cc:374] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:48:14.364564 16730 raft_consensus.cc:729] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 236f298af13f403d86bb159d104846f6, State: Initialized, Role: FOLLOWER
I20260811 16:48:14.364743 16730 consensus_queue.cc:260] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "236f298af13f403d86bb159d104846f6" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 38557 } }
I20260811 16:48:14.364809 16730 raft_consensus.cc:388] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:48:14.364879 16730 raft_consensus.cc:482] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:48:14.364934 16730 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:48:14.365489 16730 raft_consensus.cc:504] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "236f298af13f403d86bb159d104846f6" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 38557 } }
I20260811 16:48:14.365612 16730 leader_election.cc:302] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 236f298af13f403d86bb159d104846f6; no voters:
I20260811 16:48:14.365797 16730 leader_election.cc:288] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:48:14.365850 16734 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:48:14.366052 16734 raft_consensus.cc:686] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [term 1 LEADER]: Becoming Leader. State: Replica: 236f298af13f403d86bb159d104846f6, State: Running, Role: LEADER
I20260811 16:48:14.366070 16730 sys_catalog.cc:564] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:48:14.366160 16734 consensus_queue.cc:237] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "236f298af13f403d86bb159d104846f6" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 38557 } }
I20260811 16:48:14.366451 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 16632
I20260811 16:48:14.366555 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:48:14.366822 2270 external_mini_cluster.cc:1428] Setting key c008c67ba6776da522d4a3268ee989fd
I20260811 16:48:14.367852 16735 sys_catalog.cc:455] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "236f298af13f403d86bb159d104846f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "236f298af13f403d86bb159d104846f6" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 38557 } } }
I20260811 16:48:14.367695 16737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 236f298af13f403d86bb159d104846f6. Latest consensus state: current_term: 1 leader_uuid: "236f298af13f403d86bb159d104846f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "236f298af13f403d86bb159d104846f6" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 38557 } } }
I20260811 16:48:14.368000 16735 sys_catalog.cc:458] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:48:14.368006 16737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6 [sys.catalog]: This master's current role is: LEADER
W20260811 16:48:14.368346 16756 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:48:14.368404 16756 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:48:14.368467 16762 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:48:14.368669 16762 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:48:14.370770 16762 catalog_manager.cc:1347] Generated new cluster ID: 7a8ead0d6e3b4558b90b5d43d2c7c38b
I20260811 16:48:14.370827 16762 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:48:14.372922 16751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:14.367384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54362 (local address 127.2.55.190:38557)
0811 16:48:14.367719 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:14.367727 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:14.367828 (+ 101us) server_negotiation.cc:407] Connection header received
0811 16:48:14.367947 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:14.367956 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:14.368032 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:14.368228 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:14.368452 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.369758 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.370713 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.371286 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.371399 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:14.372177 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:48:14.372181 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:48:14.372181 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:48:14.372380 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:48:14.372426 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:48:14.372440 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:48:14.372505 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:14.372617 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 16:48:14.372692 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":91,"threads_started":1}
I20260811 16:48:14.382526 16762 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:48:14.383252 16762 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:48:14.388466 16762 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 236f298af13f403d86bb159d104846f6: Generated new TSK 0
I20260811 16:48:14.388657 16762 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:48:14.392753 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:38557
--builtin_ntp_servers=127.2.55.148:44429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 16:48:14.485488 16765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:48:14.485762 16765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:48:14.485803 16765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:48:14.487001 16765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:48:14.487077 16765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:48:14.487124 16765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:48:14.488535 16765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:38557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:48:14.488881 16765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:48:14.489244 16765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:48:14.495740 16775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:14.495761 16773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:14.495927 16772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:48:14.495885 16765 server_base.cc:1034] running on GCE node
I20260811 16:48:14.496265 16765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:48:14.496544 16765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:48:14.497713 16765 hybrid_clock.cc:648] HybridClock initialized: now 1786466894497703 us; error 34 us; skew 500 ppm
I20260811 16:48:14.499531 16765 webserver.cc:460] Webserver started at http://127.2.55.129:36385/ using document root <none> and password file <none>
I20260811 16:48:14.499751 16765 fs_manager.cc:359] Metadata directory not provided
I20260811 16:48:14.499795 16765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:48:14.499894 16765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:48:14.501075 16765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "81b94d0b40eb4e9aa993baeec93f4a0e"
format_stamp: "Formatted at 2026-08-11 16:48:14 on dist-test-slave-3h5h"
server_key: "a19fd86b89e1cad24d42b3ae34dc45da"
server_key_iv: "71cc495a927c4b7d218d2385b51c1611"
server_key_version: "encryptionkey@0"
I20260811 16:48:14.501400 16765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "81b94d0b40eb4e9aa993baeec93f4a0e"
format_stamp: "Formatted at 2026-08-11 16:48:14 on dist-test-slave-3h5h"
server_key: "a19fd86b89e1cad24d42b3ae34dc45da"
server_key_iv: "71cc495a927c4b7d218d2385b51c1611"
server_key_version: "encryptionkey@0"
I20260811 16:48:14.502863 16765 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:48:14.503687 16785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:14.503888 16765 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:48:14.503988 16765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "81b94d0b40eb4e9aa993baeec93f4a0e"
format_stamp: "Formatted at 2026-08-11 16:48:14 on dist-test-slave-3h5h"
server_key: "a19fd86b89e1cad24d42b3ae34dc45da"
server_key_iv: "71cc495a927c4b7d218d2385b51c1611"
server_key_version: "encryptionkey@0"
I20260811 16:48:14.504096 16765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:48:14.523205 16765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:48:14.523578 16765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:48:14.523738 16765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:48:14.524014 16765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:48:14.524402 16765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:48:14.524461 16765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:14.524495 16765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:48:14.524536 16765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:14.530895 16765 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:33457
I20260811 16:48:14.530941 16942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:33457 every 8 connection(s)
I20260811 16:48:14.531296 16765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:48:14.536718 16751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:14.532081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:60365 (local address 127.2.55.190:38557)
0811 16:48:14.532222 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:14.532225 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:14.532386 (+ 161us) server_negotiation.cc:407] Connection header received
0811 16:48:14.533007 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:14.533008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:14.533023 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:14.533087 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:14.533792 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.534278 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.535390 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.535612 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.535672 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:14.536470 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:48:14.536471 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:48:14.536471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:48:14.536476 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:48:14.536491 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:48:14.536494 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:48:14.536538 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:14.536631 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 16:48:14.536656 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260811 16:48:14.536916 16946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:14.532043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:38557 (local address 127.2.55.129:60365)
0811 16:48:14.532261 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:14.532297 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:14.532811 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:14.533174 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:14.533178 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:14.533186 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:14.533710 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:14.533715 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.534355 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.534355 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:14.535309 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:14.535312 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.535699 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.535699 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:14.535839 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:14.536339 (+ 500us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:48:14.536339 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:14.536368 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:48:14.536389 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:48:14.536551 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:48:14.536556 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:48:14.536558 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:48:14.536617 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:48:14.536698 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":114,"threads_started":1}
I20260811 16:48:14.537460 16943 heartbeater.cc:347] Connected to a master server at 127.2.55.190:38557
I20260811 16:48:14.537554 16943 heartbeater.cc:464] Registering TS with master...
I20260811 16:48:14.537720 16943 heartbeater.cc:511] Master 127.2.55.190:38557 requested a full tablet report, sending...
I20260811 16:48:14.538264 16676 ts_manager.cc:194] Registered new tserver with Master: 81b94d0b40eb4e9aa993baeec93f4a0e (127.2.55.129:33457)
I20260811 16:48:14.538961 16676 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.55.129:60365
I20260811 16:48:14.539492 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 16765
I20260811 16:48:14.539599 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:48:14.539824 2270 external_mini_cluster.cc:1428] Setting key 8bb5f241a3cbe0f8676899841ef66ff0
I20260811 16:48:14.541013 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:38557
--builtin_ntp_servers=127.2.55.148:44429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 16:48:14.627521 16947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:48:14.627774 16947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:48:14.627810 16947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:48:14.628979 16947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:48:14.629055 16947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:48:14.629094 16947 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:48:14.630617 16947 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:38557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16947
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:48:14.630888 16947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:48:14.631196 16947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:48:14.636691 16953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:14.636696 16952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:14.636680 16955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:48:14.636958 16947 server_base.cc:1034] running on GCE node
I20260811 16:48:14.637246 16947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:48:14.637504 16947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:48:14.638685 16947 hybrid_clock.cc:648] HybridClock initialized: now 1786466894638682 us; error 42 us; skew 500 ppm
I20260811 16:48:14.640928 16947 webserver.cc:460] Webserver started at http://127.2.55.130:37263/ using document root <none> and password file <none>
I20260811 16:48:14.641434 16947 fs_manager.cc:359] Metadata directory not provided
I20260811 16:48:14.641597 16947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:48:14.641803 16947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:48:14.643185 16947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "d7cd9e2955ae4c97b1e5ace355d26cae"
format_stamp: "Formatted at 2026-08-11 16:48:14 on dist-test-slave-3h5h"
server_key: "b42cb26b83bc65fc4723a0c6a5124484"
server_key_iv: "1936ab51645b36748d278e857a7a609c"
server_key_version: "encryptionkey@0"
I20260811 16:48:14.643579 16947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "d7cd9e2955ae4c97b1e5ace355d26cae"
format_stamp: "Formatted at 2026-08-11 16:48:14 on dist-test-slave-3h5h"
server_key: "b42cb26b83bc65fc4723a0c6a5124484"
server_key_iv: "1936ab51645b36748d278e857a7a609c"
server_key_version: "encryptionkey@0"
I20260811 16:48:14.645258 16947 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 16:48:14.646073 16964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:14.646266 16947 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:48:14.646376 16947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "d7cd9e2955ae4c97b1e5ace355d26cae"
format_stamp: "Formatted at 2026-08-11 16:48:14 on dist-test-slave-3h5h"
server_key: "b42cb26b83bc65fc4723a0c6a5124484"
server_key_iv: "1936ab51645b36748d278e857a7a609c"
server_key_version: "encryptionkey@0"
I20260811 16:48:14.646453 16947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:48:14.667096 16947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:48:14.667435 16947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:48:14.667588 16947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:48:14.667850 16947 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:48:14.668231 16947 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:48:14.668288 16947 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:14.668335 16947 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:48:14.668360 16947 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:14.674484 16947 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:37495
I20260811 16:48:14.674535 17142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:37495 every 8 connection(s)
I20260811 16:48:14.674881 16947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:48:14.677383 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 16947
I20260811 16:48:14.677506 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:48:14.677744 2270 external_mini_cluster.cc:1428] Setting key 9e069841a9964fd66d098aec8f386eae
I20260811 16:48:14.678903 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:38557
--builtin_ntp_servers=127.2.55.148:44429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 16:48:14.681557 16751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:14.675644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:36141 (local address 127.2.55.190:38557)
0811 16:48:14.675725 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:14.675728 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:14.675975 (+ 247us) server_negotiation.cc:407] Connection header received
0811 16:48:14.676605 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:14.676606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:14.676620 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:14.676696 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:14.677522 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.678332 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.679766 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.680108 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.680192 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:14.681203 (+ 1011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:48:14.681204 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:48:14.681205 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:48:14.681210 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:48:14.681234 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:48:14.681239 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:48:14.681304 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:14.681428 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 16:48:14.681469 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 16:48:14.681813 17145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:14.675633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:38557 (local address 127.2.55.130:36141)
0811 16:48:14.675829 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:14.675873 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:14.676471 (+ 598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:14.676767 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:14.676770 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:14.676779 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:14.677370 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:14.677375 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.678474 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.678475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:14.679657 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:14.679660 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.680219 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.680220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:14.680337 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:14.681023 (+ 686us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:48:14.681023 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:14.681056 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:48:14.681083 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:48:14.681322 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:48:14.681328 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:48:14.681332 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:48:14.681431 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 16:48:14.681556 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":93,"threads_started":1}
I20260811 16:48:14.682399 17143 heartbeater.cc:347] Connected to a master server at 127.2.55.190:38557
I20260811 16:48:14.682516 17143 heartbeater.cc:464] Registering TS with master...
I20260811 16:48:14.682729 17143 heartbeater.cc:511] Master 127.2.55.190:38557 requested a full tablet report, sending...
I20260811 16:48:14.683202 16676 ts_manager.cc:194] Registered new tserver with Master: d7cd9e2955ae4c97b1e5ace355d26cae (127.2.55.130:37495)
I20260811 16:48:14.683749 16676 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.55.130:36141
W20260811 16:48:14.764405 17146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:48:14.764614 17146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:48:14.764636 17146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:48:14.765872 17146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:48:14.765913 17146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:48:14.765937 17146 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:48:14.767375 17146 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:44429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:38557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:48:14.767627 17146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:48:14.767948 17146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:48:14.773509 17154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:14.773523 17153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:14.773528 17158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:48:14.773850 17146 server_base.cc:1034] running on GCE node
I20260811 16:48:14.774085 17146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:48:14.774305 17146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:48:14.775547 17146 hybrid_clock.cc:648] HybridClock initialized: now 1786466894775530 us; error 32 us; skew 500 ppm
I20260811 16:48:14.777010 17146 webserver.cc:460] Webserver started at http://127.2.55.131:32895/ using document root <none> and password file <none>
I20260811 16:48:14.777285 17146 fs_manager.cc:359] Metadata directory not provided
I20260811 16:48:14.777350 17146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:48:14.777524 17146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:48:14.778661 17146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "51172aaa40bb407d9408c49f3966d2c4"
format_stamp: "Formatted at 2026-08-11 16:48:14 on dist-test-slave-3h5h"
server_key: "89a381a7ee77784209efcf0ffe350eda"
server_key_iv: "b46fc027ded17d4b1c943e5c30fe743c"
server_key_version: "encryptionkey@0"
I20260811 16:48:14.779036 17146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "51172aaa40bb407d9408c49f3966d2c4"
format_stamp: "Formatted at 2026-08-11 16:48:14 on dist-test-slave-3h5h"
server_key: "89a381a7ee77784209efcf0ffe350eda"
server_key_iv: "b46fc027ded17d4b1c943e5c30fe743c"
server_key_version: "encryptionkey@0"
I20260811 16:48:14.780478 17146 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:48:14.781316 17166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:14.781504 17146 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:14.781599 17146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "51172aaa40bb407d9408c49f3966d2c4"
format_stamp: "Formatted at 2026-08-11 16:48:14 on dist-test-slave-3h5h"
server_key: "89a381a7ee77784209efcf0ffe350eda"
server_key_iv: "b46fc027ded17d4b1c943e5c30fe743c"
server_key_version: "encryptionkey@0"
I20260811 16:48:14.781675 17146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:48:14.803574 17146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:48:14.803943 17146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:48:14.804085 17146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:48:14.804368 17146 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:48:14.804754 17146 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:48:14.804812 17146 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:14.804879 17146 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:48:14.804925 17146 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:14.811285 17146 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:38011
I20260811 16:48:14.811326 17328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:38011 every 8 connection(s)
I20260811 16:48:14.811702 17146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:48:14.815915 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 17146
I20260811 16:48:14.816048 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:48:14.816368 2270 external_mini_cluster.cc:1428] Setting key a389ab8dc45d526823c5e525d41f24f0
I20260811 16:48:14.817684 16751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:14.812663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:36127 (local address 127.2.55.190:38557)
0811 16:48:14.812756 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:14.812759 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:14.813173 (+ 414us) server_negotiation.cc:407] Connection header received
0811 16:48:14.813680 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:14.813681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:14.813693 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:14.813768 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:14.814442 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.814985 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.816036 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.816377 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.816457 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:14.817440 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:48:14.817442 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:48:14.817442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:48:14.817447 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:48:14.817462 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:48:14.817466 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:48:14.817513 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:14.817569 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 16:48:14.817620 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 16:48:14.817962 17335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:14.812644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:38557 (local address 127.2.55.131:36127)
0811 16:48:14.813010 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:14.813063 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:14.813591 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:14.813820 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:14.813824 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:14.813832 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:14.814355 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:14.814359 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.815088 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.815089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:14.815919 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:14.815921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:14.816511 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:14.816512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:14.816636 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:14.817316 (+ 680us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:48:14.817317 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:14.817347 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:48:14.817370 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:48:14.817519 (+ 149us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:48:14.817522 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:48:14.817524 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:48:14.817572 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 16:48:14.817653 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":139,"threads_started":1}
I20260811 16:48:14.818492 17329 heartbeater.cc:347] Connected to a master server at 127.2.55.190:38557
I20260811 16:48:14.818598 17329 heartbeater.cc:464] Registering TS with master...
I20260811 16:48:14.818765 17329 heartbeater.cc:511] Master 127.2.55.190:38557 requested a full tablet report, sending...
I20260811 16:48:14.819186 16676 ts_manager.cc:194] Registered new tserver with Master: 51172aaa40bb407d9408c49f3966d2c4 (127.2.55.131:38011)
I20260811 16:48:14.819545 16676 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.55.131:36127
I20260811 16:48:14.828439 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 16:48:14.830883 16751 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:14.830248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54370 (local address 127.2.55.190:38557)
0811 16:48:14.830323 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:14.830326 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:14.830457 (+ 131us) server_negotiation.cc:407] Connection header received
0811 16:48:14.830537 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:14.830538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:14.830552 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:14.830656 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:14.830813 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54370: BlockingRecv error: recv got EOF from 127.0.0.1:54370 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 16:48:14.831161 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 16765
I20260811 16:48:14.842146 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 16947
I20260811 16:48:14.857014 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 17146
I20260811 16:48:14.894879 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 16632
2026-08-11T16:48:14Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (730 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T16:48:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:48:14Z Disabled control of system clock
I20260811 16:48:14.938829 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:40181
--webserver_interface=127.2.55.190
--webserver_port=0
--builtin_ntp_servers=127.2.55.148:46685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:40181
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 16:48:15.028175 17346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:48:15.028403 17346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:48:15.028425 17346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:48:15.029750 17346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:48:15.029793 17346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:48:15.029806 17346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:48:15.029819 17346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:48:15.029831 17346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:48:15.031297 17346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:46685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:40181
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:40181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:48:15.031515 17346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:48:15.031764 17346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:48:15.036909 17356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:15.037026 17355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:48:15.037161 17346 server_base.cc:1034] running on GCE node
W20260811 16:48:15.036909 17359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:48:15.037505 17346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:48:15.037817 17346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:48:15.038996 17346 hybrid_clock.cc:648] HybridClock initialized: now 1786466895038978 us; error 37 us; skew 500 ppm
I20260811 16:48:15.040459 17346 webserver.cc:460] Webserver started at http://127.2.55.190:43111/ using document root <none> and password file <none>
I20260811 16:48:15.040755 17346 fs_manager.cc:359] Metadata directory not provided
I20260811 16:48:15.040833 17346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:48:15.041013 17346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:48:15.042210 17346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "80e96774497b4bd694cf0fb300d12dbb"
format_stamp: "Formatted at 2026-08-11 16:48:15 on dist-test-slave-3h5h"
server_key: "ed1a8801093800c3d1102a5c2d4b6633"
server_key_iv: "dece4f3c94d52e101c02c8c70ed49358"
server_key_version: "encryptionkey@0"
I20260811 16:48:15.042585 17346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "80e96774497b4bd694cf0fb300d12dbb"
format_stamp: "Formatted at 2026-08-11 16:48:15 on dist-test-slave-3h5h"
server_key: "ed1a8801093800c3d1102a5c2d4b6633"
server_key_iv: "dece4f3c94d52e101c02c8c70ed49358"
server_key_version: "encryptionkey@0"
I20260811 16:48:15.044008 17346 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:48:15.044909 17368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:15.045104 17346 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:48:15.045202 17346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "80e96774497b4bd694cf0fb300d12dbb"
format_stamp: "Formatted at 2026-08-11 16:48:15 on dist-test-slave-3h5h"
server_key: "ed1a8801093800c3d1102a5c2d4b6633"
server_key_iv: "dece4f3c94d52e101c02c8c70ed49358"
server_key_version: "encryptionkey@0"
I20260811 16:48:15.045287 17346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:48:15.048916 17346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:48:15.049220 17346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:48:15.049371 17346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:48:15.053751 17346 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:40181
I20260811 16:48:15.053799 17444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:40181 every 8 connection(s)
I20260811 16:48:15.054163 17346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:48:15.054836 17445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:48:15.058185 17445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb: Bootstrap starting.
I20260811 16:48:15.058835 17445 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb: Neither blocks nor log segments found. Creating new log.
I20260811 16:48:15.059158 17445 log.cc:824] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb: Log is configured to *not* fsync() on all Append() calls
I20260811 16:48:15.059911 17445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb: No bootstrap required, opened a new log
I20260811 16:48:15.061738 17445 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e96774497b4bd694cf0fb300d12dbb" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40181 } }
I20260811 16:48:15.061910 17445 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:48:15.061962 17445 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80e96774497b4bd694cf0fb300d12dbb, State: Initialized, Role: FOLLOWER
I20260811 16:48:15.062144 17445 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e96774497b4bd694cf0fb300d12dbb" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40181 } }
I20260811 16:48:15.062233 17445 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:48:15.062278 17445 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:48:15.062328 17445 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:48:15.062899 17445 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e96774497b4bd694cf0fb300d12dbb" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40181 } }
I20260811 16:48:15.063035 17445 leader_election.cc:302] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80e96774497b4bd694cf0fb300d12dbb; no voters:
I20260811 16:48:15.063231 17445 leader_election.cc:288] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:48:15.063342 17448 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:48:15.063513 17445 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:48:15.063525 17448 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [term 1 LEADER]: Becoming Leader. State: Replica: 80e96774497b4bd694cf0fb300d12dbb, State: Running, Role: LEADER
I20260811 16:48:15.063686 17448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e96774497b4bd694cf0fb300d12dbb" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40181 } }
I20260811 16:48:15.063972 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 17346
I20260811 16:48:15.064080 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:48:15.064345 2270 external_mini_cluster.cc:1428] Setting key c730a22b23122ae9fb3a007607614c19
I20260811 16:48:15.064338 17449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80e96774497b4bd694cf0fb300d12dbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e96774497b4bd694cf0fb300d12dbb" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40181 } } }
I20260811 16:48:15.064431 17449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [sys.catalog]: This master's current role is: LEADER
I20260811 16:48:15.064689 17459 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:48:15.064790 17450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80e96774497b4bd694cf0fb300d12dbb. Latest consensus state: current_term: 1 leader_uuid: "80e96774497b4bd694cf0fb300d12dbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e96774497b4bd694cf0fb300d12dbb" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40181 } } }
I20260811 16:48:15.064913 17450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb [sys.catalog]: This master's current role is: LEADER
I20260811 16:48:15.065412 17459 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:48:15.067992 17459 catalog_manager.cc:1347] Generated new cluster ID: 1ffa5d1b11584a8fa6910a5cf860bb1c
I20260811 16:48:15.068081 17459 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:48:15.068166 17472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:15.065150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51736 (local address 127.2.55.190:40181)
0811 16:48:15.066316 (+ 1166us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:15.066323 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:15.066350 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:48:15.066439 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:15.066445 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:15.066479 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:15.066648 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:15.067433 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:48:15.067437 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:48:15.067437 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:48:15.067442 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:48:15.067503 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:48:15.067519 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:48:15.067605 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:15.067782 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 16:48:15.067845 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1061,"thread_start_us":79,"threads_started":1}
I20260811 16:48:15.094470 17459 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:48:15.094736 17459 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:48:15.101433 17459 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80e96774497b4bd694cf0fb300d12dbb: Generated new TSK 0
I20260811 16:48:15.101691 17459 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:48:15.105997 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40181
--builtin_ntp_servers=127.2.55.148:46685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 16:48:15.194350 17476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:48:15.194621 17476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:48:15.194664 17476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:48:15.196002 17476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:48:15.196074 17476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:48:15.196117 17476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:48:15.197646 17476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:46685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:48:15.197939 17476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:48:15.198272 17476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:48:15.203841 17484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:15.203836 17483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:15.203836 17488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:48:15.203855 17476 server_base.cc:1034] running on GCE node
I20260811 16:48:15.204423 17476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:48:15.204715 17476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:48:15.205890 17476 hybrid_clock.cc:648] HybridClock initialized: now 1786466895205872 us; error 52 us; skew 500 ppm
I20260811 16:48:15.207278 17476 webserver.cc:460] Webserver started at http://127.2.55.129:37845/ using document root <none> and password file <none>
I20260811 16:48:15.207587 17476 fs_manager.cc:359] Metadata directory not provided
I20260811 16:48:15.207666 17476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:48:15.207823 17476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:48:15.209056 17476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "6f8fcb09323b4c029245007250eb04c1"
format_stamp: "Formatted at 2026-08-11 16:48:15 on dist-test-slave-3h5h"
server_key: "390f6fab985bc772d79e9993a94e5aab"
server_key_iv: "d7f0d9d2ad12a212a0d5e8531486cd88"
server_key_version: "encryptionkey@0"
I20260811 16:48:15.209434 17476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "6f8fcb09323b4c029245007250eb04c1"
format_stamp: "Formatted at 2026-08-11 16:48:15 on dist-test-slave-3h5h"
server_key: "390f6fab985bc772d79e9993a94e5aab"
server_key_iv: "d7f0d9d2ad12a212a0d5e8531486cd88"
server_key_version: "encryptionkey@0"
I20260811 16:48:15.210888 17476 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:48:15.211815 17497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:15.212106 17476 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:48:15.212224 17476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "6f8fcb09323b4c029245007250eb04c1"
format_stamp: "Formatted at 2026-08-11 16:48:15 on dist-test-slave-3h5h"
server_key: "390f6fab985bc772d79e9993a94e5aab"
server_key_iv: "d7f0d9d2ad12a212a0d5e8531486cd88"
server_key_version: "encryptionkey@0"
I20260811 16:48:15.212306 17476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:48:15.215957 17476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:48:15.216251 17476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:48:15.216396 17476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:48:15.216621 17476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:48:15.217028 17476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:48:15.217093 17476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:15.217136 17476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:48:15.217165 17476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:15.223475 17476 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:42569
I20260811 16:48:15.223556 17668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:42569 every 8 connection(s)
I20260811 16:48:15.223935 17476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:48:15.227013 17472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:15.224770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:55371 (local address 127.2.55.190:40181)
0811 16:48:15.224890 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:15.224892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:15.225114 (+ 222us) server_negotiation.cc:407] Connection header received
0811 16:48:15.225628 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:15.225629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:15.225638 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:15.225691 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:15.226815 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:48:15.226817 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:48:15.226817 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:48:15.226821 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:48:15.226838 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:48:15.226843 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:48:15.226892 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:15.226943 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 16:48:15.226958 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 16:48:15.227219 17671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:15.224730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:40181 (local address 127.2.55.129:55371)
0811 16:48:15.224986 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:15.225022 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:15.225515 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:15.225753 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:15.225756 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:15.225765 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:15.226665 (+ 900us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:48:15.226666 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:15.226693 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:48:15.226722 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:48:15.226896 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:48:15.226898 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:48:15.226900 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:48:15.226950 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 16:48:15.226999 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":131,"threads_started":1}
I20260811 16:48:15.227820 17669 heartbeater.cc:347] Connected to a master server at 127.2.55.190:40181
I20260811 16:48:15.227927 17669 heartbeater.cc:464] Registering TS with master...
I20260811 16:48:15.228087 17669 heartbeater.cc:511] Master 127.2.55.190:40181 requested a full tablet report, sending...
I20260811 16:48:15.228703 17390 ts_manager.cc:194] Registered new tserver with Master: 6f8fcb09323b4c029245007250eb04c1 (127.2.55.129:42569)
I20260811 16:48:15.232324 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 17476
I20260811 16:48:15.232406 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:48:15.232628 2270 external_mini_cluster.cc:1428] Setting key 13254581b271ed58fdb4b3b983647081
I20260811 16:48:15.233888 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40181
--builtin_ntp_servers=127.2.55.148:46685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 16:48:15.323132 17673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:48:15.323350 17673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:48:15.323374 17673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:48:15.324484 17673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:48:15.324515 17673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:48:15.324540 17673 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:48:15.325929 17673 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:46685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17673
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:48:15.326133 17673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:48:15.326380 17673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:48:15.332057 17681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:48:15.332194 17673 server_base.cc:1034] running on GCE node
W20260811 16:48:15.332053 17683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:15.332057 17687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:48:15.332556 17673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:48:15.332774 17673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:48:15.333925 17673 hybrid_clock.cc:648] HybridClock initialized: now 1786466895333912 us; error 30 us; skew 500 ppm
I20260811 16:48:15.335304 17673 webserver.cc:460] Webserver started at http://127.2.55.130:45721/ using document root <none> and password file <none>
I20260811 16:48:15.335582 17673 fs_manager.cc:359] Metadata directory not provided
I20260811 16:48:15.335660 17673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:48:15.335824 17673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:48:15.337011 17673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "ee75293fd53a408190bc56afb2e9b5e4"
format_stamp: "Formatted at 2026-08-11 16:48:15 on dist-test-slave-3h5h"
server_key: "d5cb55e46cd0e61f1a43eba6789fce19"
server_key_iv: "c9349cf16734f36862a85723c6fe78bd"
server_key_version: "encryptionkey@0"
I20260811 16:48:15.337383 17673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "ee75293fd53a408190bc56afb2e9b5e4"
format_stamp: "Formatted at 2026-08-11 16:48:15 on dist-test-slave-3h5h"
server_key: "d5cb55e46cd0e61f1a43eba6789fce19"
server_key_iv: "c9349cf16734f36862a85723c6fe78bd"
server_key_version: "encryptionkey@0"
I20260811 16:48:15.338822 17673 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:48:15.339612 17699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:15.339824 17673 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:48:15.339954 17673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "ee75293fd53a408190bc56afb2e9b5e4"
format_stamp: "Formatted at 2026-08-11 16:48:15 on dist-test-slave-3h5h"
server_key: "d5cb55e46cd0e61f1a43eba6789fce19"
server_key_iv: "c9349cf16734f36862a85723c6fe78bd"
server_key_version: "encryptionkey@0"
I20260811 16:48:15.340034 17673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:48:15.343506 17673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:48:15.343786 17673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:48:15.343928 17673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:48:15.344143 17673 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:48:15.344463 17673 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:48:15.344528 17673 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:15.344570 17673 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:48:15.344597 17673 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:15.351150 17673 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:39457
I20260811 16:48:15.351212 17881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:39457 every 8 connection(s)
I20260811 16:48:15.351584 17673 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:48:15.354832 17472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:15.352432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:57097 (local address 127.2.55.190:40181)
0811 16:48:15.352521 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:15.352523 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:15.352789 (+ 266us) server_negotiation.cc:407] Connection header received
0811 16:48:15.353382 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:15.353383 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:15.353389 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:15.353447 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:15.354623 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:48:15.354624 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:48:15.354624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:48:15.354628 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:48:15.354645 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:48:15.354649 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:48:15.354698 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:15.354757 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 16:48:15.354770 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 16:48:15.355044 17885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:15.352399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:40181 (local address 127.2.55.130:57097)
0811 16:48:15.352665 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:15.352701 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:15.353271 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:15.353500 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:15.353503 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:15.353512 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:15.354474 (+ 962us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:48:15.354474 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:15.354504 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:48:15.354534 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:48:15.354695 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:48:15.354698 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:48:15.354700 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:48:15.354751 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 16:48:15.354799 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":123,"threads_started":1}
I20260811 16:48:15.355589 17882 heartbeater.cc:347] Connected to a master server at 127.2.55.190:40181
I20260811 16:48:15.355674 17882 heartbeater.cc:464] Registering TS with master...
I20260811 16:48:15.355851 17882 heartbeater.cc:511] Master 127.2.55.190:40181 requested a full tablet report, sending...
I20260811 16:48:15.356282 17390 ts_manager.cc:194] Registered new tserver with Master: ee75293fd53a408190bc56afb2e9b5e4 (127.2.55.130:39457)
I20260811 16:48:15.360184 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 17673
I20260811 16:48:15.360278 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:48:15.360496 2270 external_mini_cluster.cc:1428] Setting key ffe17fce46facc353069c18c52b5e433
I20260811 16:48:15.361727 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40181
--builtin_ntp_servers=127.2.55.148:46685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 16:48:15.452160 17886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:48:15.452363 17886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:48:15.452385 17886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:48:15.453574 17886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:48:15.453616 17886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:48:15.453642 17886 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:48:15.454958 17886 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:46685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:40181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:48:15.455163 17886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:48:15.455407 17886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:48:15.460677 17898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:48:15.460700 17886 server_base.cc:1034] running on GCE node
W20260811 16:48:15.460666 17895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:15.460661 17893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:48:15.461158 17886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:48:15.461364 17886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:48:15.462503 17886 hybrid_clock.cc:648] HybridClock initialized: now 1786466895462501 us; error 43 us; skew 500 ppm
I20260811 16:48:15.463841 17886 webserver.cc:460] Webserver started at http://127.2.55.131:43793/ using document root <none> and password file <none>
I20260811 16:48:15.464162 17886 fs_manager.cc:359] Metadata directory not provided
I20260811 16:48:15.464213 17886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:48:15.464308 17886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:48:15.465485 17886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "fed2fcd256c24b339a5460af4622198b"
format_stamp: "Formatted at 2026-08-11 16:48:15 on dist-test-slave-3h5h"
server_key: "cb8fce03dfd8152e5a169c540990b92d"
server_key_iv: "af0a1c47fca3f49746d1bd25b9322613"
server_key_version: "encryptionkey@0"
I20260811 16:48:15.465801 17886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "fed2fcd256c24b339a5460af4622198b"
format_stamp: "Formatted at 2026-08-11 16:48:15 on dist-test-slave-3h5h"
server_key: "cb8fce03dfd8152e5a169c540990b92d"
server_key_iv: "af0a1c47fca3f49746d1bd25b9322613"
server_key_version: "encryptionkey@0"
I20260811 16:48:15.467208 17886 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:48:15.467974 17906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:15.468186 17886 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:48:15.468263 17886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "fed2fcd256c24b339a5460af4622198b"
format_stamp: "Formatted at 2026-08-11 16:48:15 on dist-test-slave-3h5h"
server_key: "cb8fce03dfd8152e5a169c540990b92d"
server_key_iv: "af0a1c47fca3f49746d1bd25b9322613"
server_key_version: "encryptionkey@0"
I20260811 16:48:15.468318 17886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:48:15.471755 17886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:48:15.471994 17886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:48:15.472093 17886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:48:15.472249 17886 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:48:15.472569 17886 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:48:15.472604 17886 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:15.472623 17886 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:48:15.472666 17886 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:15.478778 17886 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:36451
I20260811 16:48:15.478859 18080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:36451 every 8 connection(s)
I20260811 16:48:15.480057 17886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:48:15.483076 17472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:15.480822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:56977 (local address 127.2.55.190:40181)
0811 16:48:15.480881 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:15.480883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:15.481115 (+ 232us) server_negotiation.cc:407] Connection header received
0811 16:48:15.481623 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:15.481624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:15.481631 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:15.481686 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:15.482874 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:48:15.482875 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:48:15.482876 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:48:15.482881 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:48:15.482897 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:48:15.482902 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:48:15.482951 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:15.482997 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 16:48:15.483013 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 16:48:15.483309 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:15.480788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:40181 (local address 127.2.55.131:56977)
0811 16:48:15.481006 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:15.481040 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:15.481526 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:15.481735 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:15.481739 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:15.481746 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:15.482718 (+ 972us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:48:15.482719 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:15.482747 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:48:15.482775 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:48:15.482948 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:48:15.482950 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:48:15.482953 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:48:15.483002 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 16:48:15.483048 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":129,"threads_started":1}
I20260811 16:48:15.483808 18081 heartbeater.cc:347] Connected to a master server at 127.2.55.190:40181
I20260811 16:48:15.483887 18081 heartbeater.cc:464] Registering TS with master...
I20260811 16:48:15.484061 18081 heartbeater.cc:511] Master 127.2.55.190:40181 requested a full tablet report, sending...
I20260811 16:48:15.484441 17390 ts_manager.cc:194] Registered new tserver with Master: fed2fcd256c24b339a5460af4622198b (127.2.55.131:36451)
I20260811 16:48:15.487783 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 17886
I20260811 16:48:15.487872 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:48:15.488024 2270 external_mini_cluster.cc:1428] Setting key e1a5e429f5f23f04703cb67e23ba9307
I20260811 16:48:15.488955 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 16:48:15.490811 17472 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:48:15.490258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51740 (local address 127.2.55.190:40181)
0811 16:48:15.490342 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:15.490343 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:15.490444 (+ 101us) server_negotiation.cc:407] Connection header received
0811 16:48:15.490522 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:15.490523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:15.490529 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:15.490587 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:15.490744 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51740: BlockingRecv error: recv got EOF from 127.0.0.1:51740 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 16:48:15.490860 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 17476
I20260811 16:48:15.511785 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 17673
I20260811 16:48:15.526818 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 17886
I20260811 16:48:15.536381 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 17346
2026-08-11T16:48:15Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (631 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:48:15 dist-test-slave-3h5h krb5kdc[18097](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:48:15 dist-test-slave-3h5h krb5kdc[18097](info): set up 2 sockets
Aug 11 16:48:15 dist-test-slave-3h5h krb5kdc[18097](info): commencing operation
krb5kdc: starting...
W20260811 16:48:16.830103 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.269s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:48:16 dist-test-slave-3h5h krb5kdc[18097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:48:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:48:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:48:16.969395 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:41807
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:37433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:41807
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:48:17.058280 18116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:48:17.058517 18116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:48:17.058542 18116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:48:17.059820 18116 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:48:17.059859 18116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:48:17.059875 18116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:48:17.059887 18116 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:48:17.059899 18116 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:48:17.061620 18116 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:37433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:41807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:41807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:48:17.061920 18116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:48:17.062178 18116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:48:17.067513 18124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:17.067508 18126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:17.067508 18121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:48:17.068492 18116 server_base.cc:1034] running on GCE node
I20260811 16:48:17.068770 18116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:48:17.069157 18116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:48:17.070318 18116 hybrid_clock.cc:648] HybridClock initialized: now 1786466897070293 us; error 37 us; skew 500 ppm
Aug 11 16:48:17 dist-test-slave-3h5h krb5kdc[18097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466897, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:48:17.076519 18116 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:48:17.077160 18116 webserver.cc:460] Webserver started at http://127.2.55.190:40565/ using document root <none> and password file <none>
I20260811 16:48:17.077407 18116 fs_manager.cc:359] Metadata directory not provided
I20260811 16:48:17.077452 18116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:48:17.077625 18116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:48:17.079092 18116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "35bba8ba12754c899f7b30e23d3ab8b4"
format_stamp: "Formatted at 2026-08-11 16:48:17 on dist-test-slave-3h5h"
server_key: "15de6a9d54bef26b49336571902f2356"
server_key_iv: "784029b264065dfe31832ad5d28c97f6"
server_key_version: "encryptionkey@0"
I20260811 16:48:17.079555 18116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "35bba8ba12754c899f7b30e23d3ab8b4"
format_stamp: "Formatted at 2026-08-11 16:48:17 on dist-test-slave-3h5h"
server_key: "15de6a9d54bef26b49336571902f2356"
server_key_iv: "784029b264065dfe31832ad5d28c97f6"
server_key_version: "encryptionkey@0"
I20260811 16:48:17.081332 18116 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260811 16:48:17.082294 18137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:17.082527 18116 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:48:17.082644 18116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "35bba8ba12754c899f7b30e23d3ab8b4"
format_stamp: "Formatted at 2026-08-11 16:48:17 on dist-test-slave-3h5h"
server_key: "15de6a9d54bef26b49336571902f2356"
server_key_iv: "784029b264065dfe31832ad5d28c97f6"
server_key_version: "encryptionkey@0"
I20260811 16:48:17.082732 18116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:48:17.097790 18116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:48:17.100333 18116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:48:17.100513 18116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:48:17.105412 18116 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:41807
I20260811 16:48:17.105477 18220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:41807 every 8 connection(s)
I20260811 16:48:17.105883 18116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:48:17.107134 18223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:48:17.110553 18223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4: Bootstrap starting.
I20260811 16:48:17.111276 18223 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4: Neither blocks nor log segments found. Creating new log.
I20260811 16:48:17.111632 18223 log.cc:824] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4: Log is configured to *not* fsync() on all Append() calls
I20260811 16:48:17.112576 18223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4: No bootstrap required, opened a new log
I20260811 16:48:17.114614 18223 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35bba8ba12754c899f7b30e23d3ab8b4" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41807 } }
I20260811 16:48:17.114759 18223 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:48:17.114782 18223 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35bba8ba12754c899f7b30e23d3ab8b4, State: Initialized, Role: FOLLOWER
I20260811 16:48:17.114961 18223 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35bba8ba12754c899f7b30e23d3ab8b4" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41807 } }
I20260811 16:48:17.115041 18223 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:48:17.115064 18223 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:48:17.115094 18223 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:48:17.115993 18223 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35bba8ba12754c899f7b30e23d3ab8b4" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41807 } }
I20260811 16:48:17.116088 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 18116
I20260811 16:48:17.116128 18223 leader_election.cc:302] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35bba8ba12754c899f7b30e23d3ab8b4; no voters:
I20260811 16:48:17.116210 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:48:17.116313 18223 leader_election.cc:288] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:48:17.116344 18226 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:48:17.116457 18226 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [term 1 LEADER]: Becoming Leader. State: Replica: 35bba8ba12754c899f7b30e23d3ab8b4, State: Running, Role: LEADER
I20260811 16:48:17.116478 2270 external_mini_cluster.cc:1428] Setting key 3ff440b77e94d84163194f5bba05097c
I20260811 16:48:17.116547 18226 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35bba8ba12754c899f7b30e23d3ab8b4" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41807 } }
I20260811 16:48:17.116598 18223 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:48:17.116917 18227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35bba8ba12754c899f7b30e23d3ab8b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35bba8ba12754c899f7b30e23d3ab8b4" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41807 } } }
I20260811 16:48:17.117000 18227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [sys.catalog]: This master's current role is: LEADER
I20260811 16:48:17.116902 18226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35bba8ba12754c899f7b30e23d3ab8b4. Latest consensus state: current_term: 1 leader_uuid: "35bba8ba12754c899f7b30e23d3ab8b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35bba8ba12754c899f7b30e23d3ab8b4" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41807 } } }
I20260811 16:48:17.117198 18226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4 [sys.catalog]: This master's current role is: LEADER
W20260811 16:48:17.118625 18252 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:48:17.118693 18252 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:48:17.118746 18232 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:48:17.118921 18232 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:48:17.120441 18232 catalog_manager.cc:1347] Generated new cluster ID: 6592e6b45a0249709ab3c73457c8d61f
I20260811 16:48:17.120496 18232 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:48:17 dist-test-slave-3h5h krb5kdc[18097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:48:17.128793 18233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.117020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60000 (local address 127.2.55.190:41807)
0811 16:48:17.117806 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:17.117816 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:17.118115 (+ 299us) server_negotiation.cc:407] Connection header received
0811 16:48:17.118250 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:17.118259 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:17.118341 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:17.118491 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:17.119297 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.120621 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.121432 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.121849 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.121982 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.124583 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:48:17.124592 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:48:17.124592 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:48:17.124604 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:48:17.126601 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:48:17.127012 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:48:17.127015 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:48:17.127016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:48:17.127143 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:48:17.127359 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:48:17.127360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:48:17.127360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:48:17.127691 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:48:17.127858 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:17.128386 (+ 528us) server_negotiation.cc:299] Negotiation successful
0811 16:48:17.128547 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":737,"thread_start_us":107,"threads_started":1}
I20260811 16:48:17.152351 18232 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:48:17.152982 18232 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:48:17.159178 18232 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4: Generated new TSK 0
I20260811 16:48:17.159387 18232 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:48:17.200582 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41807
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:37433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:48:17.309369 18257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:48:17.309604 18257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:48:17.309645 18257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:48:17.310827 18257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:48:17.310895 18257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:48:17.310942 18257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:48:17.312451 18257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:37433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:48:17.312724 18257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:48:17.313019 18257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:48:17.318259 18264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:17.318282 18263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:17.318300 18267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:48:17.318444 18257 server_base.cc:1034] running on GCE node
I20260811 16:48:17.318769 18257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:48:17.318974 18257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:48:17.320116 18257 hybrid_clock.cc:648] HybridClock initialized: now 1786466897320092 us; error 41 us; skew 500 ppm
Aug 11 16:48:17 dist-test-slave-3h5h krb5kdc[18097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466897, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:48:17.322701 18257 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:48:17.323153 18257 webserver.cc:460] Webserver started at http://127.2.55.129:45435/ using document root <none> and password file <none>
I20260811 16:48:17.323340 18257 fs_manager.cc:359] Metadata directory not provided
I20260811 16:48:17.323380 18257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:48:17.323467 18257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:48:17.324479 18257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "251b6738a29b4eea861062d13adc3635"
format_stamp: "Formatted at 2026-08-11 16:48:17 on dist-test-slave-3h5h"
server_key: "93c195235f61d53490fe7c51617f8a58"
server_key_iv: "181c748e1098055bf8ad79a0bc264f17"
server_key_version: "encryptionkey@0"
I20260811 16:48:17.324806 18257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "251b6738a29b4eea861062d13adc3635"
format_stamp: "Formatted at 2026-08-11 16:48:17 on dist-test-slave-3h5h"
server_key: "93c195235f61d53490fe7c51617f8a58"
server_key_iv: "181c748e1098055bf8ad79a0bc264f17"
server_key_version: "encryptionkey@0"
I20260811 16:48:17.326269 18257 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:48:17.326963 18278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:17.327123 18257 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:48:17.327229 18257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "251b6738a29b4eea861062d13adc3635"
format_stamp: "Formatted at 2026-08-11 16:48:17 on dist-test-slave-3h5h"
server_key: "93c195235f61d53490fe7c51617f8a58"
server_key_iv: "181c748e1098055bf8ad79a0bc264f17"
server_key_version: "encryptionkey@0"
I20260811 16:48:17.327296 18257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:48:17.343811 18257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:48:17.345800 18257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:48:17.345913 18257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:48:17.346108 18257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:48:17.346451 18257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:48:17.346486 18257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:17.346508 18257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:48:17.346557 18257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:17.352463 18257 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:41783
I20260811 16:48:17.352526 18445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:41783 every 8 connection(s)
I20260811 16:48:17.352914 18257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:48:17.358024 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 18257
I20260811 16:48:17.358179 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:48:17.358405 2270 external_mini_cluster.cc:1428] Setting key b9ebbf09754bff1ebad4567b4b55a072
Aug 11 16:48:17 dist-test-slave-3h5h krb5kdc[18097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466897, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:48:17.362799 18233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.353739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:40161 (local address 127.2.55.190:41807)
0811 16:48:17.353786 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:17.353788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:17.354002 (+ 214us) server_negotiation.cc:407] Connection header received
0811 16:48:17.354472 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:17.354473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:17.354482 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:17.354539 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:17.355466 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.355971 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.357045 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.357238 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.357296 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.359629 (+ 2333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:48:17.359631 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:48:17.359631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:48:17.359640 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:48:17.361391 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:48:17.361814 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:48:17.361815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:48:17.361815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:48:17.361883 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:48:17.362120 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:48:17.362122 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:48:17.362122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:48:17.362257 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:48:17.362340 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:17.362665 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 16:48:17.362735 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:48:17.363134 18448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.353666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:41807 (local address 127.2.55.129:40161)
0811 16:48:17.353861 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:17.353904 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:17.354392 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:17.354600 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:17.354603 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:17.355185 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:17.355380 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:17.355386 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.356059 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.356060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:17.356964 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:17.356967 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.357317 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.357318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:17.357418 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.357899 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:17.357907 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:17.359524 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:48:17.361480 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:48:17.361488 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:48:17.361490 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:48:17.361735 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:48:17.361953 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:48:17.361954 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:48:17.361954 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:48:17.362054 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:48:17.362348 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:48:17.362356 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:48:17.362523 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 16:48:17.362665 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 16:48:17.362854 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":118,"threads_started":1}
I20260811 16:48:17.363714 18446 heartbeater.cc:347] Connected to a master server at 127.2.55.190:41807
I20260811 16:48:17.363842 18446 heartbeater.cc:464] Registering TS with master...
I20260811 16:48:17.364063 18446 heartbeater.cc:511] Master 127.2.55.190:41807 requested a full tablet report, sending...
I20260811 16:48:17.364634 18158 ts_manager.cc:194] Registered new tserver with Master: 251b6738a29b4eea861062d13adc3635 (127.2.55.129:41783)
I20260811 16:48:17.365363 18158 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:40161
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:48:17.388384 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41807
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:37433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:48:17.474565 18452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:48:17.474817 18452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:48:17.474860 18452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:48:17.476076 18452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:48:17.476153 18452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:48:17.476205 18452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:48:17.477876 18452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:37433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:48:17.478152 18452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:48:17.478406 18452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:48:17.484107 18460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:17.484205 18465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:17.484226 18462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:48:17.484270 18452 server_base.cc:1034] running on GCE node
I20260811 16:48:17.484582 18452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:48:17.484889 18452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:48:17.486066 18452 hybrid_clock.cc:648] HybridClock initialized: now 1786466897486057 us; error 39 us; skew 500 ppm
Aug 11 16:48:17 dist-test-slave-3h5h krb5kdc[18097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466897, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:48:17.488780 18452 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:48:17.489316 18452 webserver.cc:460] Webserver started at http://127.2.55.130:42283/ using document root <none> and password file <none>
I20260811 16:48:17.489558 18452 fs_manager.cc:359] Metadata directory not provided
I20260811 16:48:17.489629 18452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:48:17.489789 18452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:48:17.490906 18452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "7b8c8aa258a649099495317e5fa16cee"
format_stamp: "Formatted at 2026-08-11 16:48:17 on dist-test-slave-3h5h"
server_key: "76cd77cb66b45ff5f14c88643ef00656"
server_key_iv: "36d7d79f3df7d6e6fdcd6890a8816c6f"
server_key_version: "encryptionkey@0"
I20260811 16:48:17.491293 18452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "7b8c8aa258a649099495317e5fa16cee"
format_stamp: "Formatted at 2026-08-11 16:48:17 on dist-test-slave-3h5h"
server_key: "76cd77cb66b45ff5f14c88643ef00656"
server_key_iv: "36d7d79f3df7d6e6fdcd6890a8816c6f"
server_key_version: "encryptionkey@0"
I20260811 16:48:17.492735 18452 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:48:17.493602 18475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:17.493860 18452 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:48:17.493969 18452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "7b8c8aa258a649099495317e5fa16cee"
format_stamp: "Formatted at 2026-08-11 16:48:17 on dist-test-slave-3h5h"
server_key: "76cd77cb66b45ff5f14c88643ef00656"
server_key_iv: "36d7d79f3df7d6e6fdcd6890a8816c6f"
server_key_version: "encryptionkey@0"
I20260811 16:48:17.494035 18452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:48:17.509353 18452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:48:17.512048 18452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:48:17.512183 18452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:48:17.512410 18452 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:48:17.512717 18452 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:48:17.512753 18452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:17.512778 18452 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:48:17.512792 18452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:17.519791 18452 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:34689
I20260811 16:48:17.519872 18648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:34689 every 8 connection(s)
I20260811 16:48:17.520270 18452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:48:17.524348 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 18452
I20260811 16:48:17.524458 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:48:17.524664 2270 external_mini_cluster.cc:1428] Setting key 5ce75de14c9e75dfdb66a24e14da2c7c
Aug 11 16:48:17 dist-test-slave-3h5h krb5kdc[18097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466897, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:48:17.531221 18233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.521187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:50511 (local address 127.2.55.190:41807)
0811 16:48:17.521243 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:17.521246 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:17.521430 (+ 184us) server_negotiation.cc:407] Connection header received
0811 16:48:17.521927 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:17.521928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:17.521939 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:17.522015 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:17.523025 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.523614 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.524917 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.525162 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.525219 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.527818 (+ 2599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:48:17.527820 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:48:17.527821 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:48:17.527830 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:48:17.529489 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:48:17.530046 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:48:17.530048 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:48:17.530049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:48:17.530124 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:48:17.530445 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:48:17.530446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:48:17.530447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:48:17.530589 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:48:17.530677 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:17.531005 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 16:48:17.531104 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:48:17.531469 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.521087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:41807 (local address 127.2.55.130:50511)
0811 16:48:17.521294 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:17.521341 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:17.521835 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:17.522096 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:17.522099 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:17.522714 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:17.522911 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:17.522915 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.523708 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.523709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:17.524807 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:17.524810 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.525246 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.525247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:17.525387 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.525921 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:17.525932 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:17.527714 (+ 1782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:48:17.529609 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:48:17.529617 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:48:17.529620 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:48:17.529872 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:48:17.530218 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:48:17.530219 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:48:17.530220 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:48:17.530363 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:48:17.530683 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:48:17.530691 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:48:17.530839 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 16:48:17.530957 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 16:48:17.531201 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":87,"threads_started":1}
I20260811 16:48:17.532020 18649 heartbeater.cc:347] Connected to a master server at 127.2.55.190:41807
I20260811 16:48:17.532153 18649 heartbeater.cc:464] Registering TS with master...
I20260811 16:48:17.532373 18649 heartbeater.cc:511] Master 127.2.55.190:41807 requested a full tablet report, sending...
I20260811 16:48:17.532907 18158 ts_manager.cc:194] Registered new tserver with Master: 7b8c8aa258a649099495317e5fa16cee (127.2.55.130:34689)
I20260811 16:48:17.533442 18158 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:50511
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:48:17.557272 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41807
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:37433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:48:17.642056 18655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:48:17.642279 18655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:48:17.642334 18655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:48:17.643462 18655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:48:17.643503 18655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:48:17.643530 18655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:48:17.645005 18655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:37433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:48:17.645197 18655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:48:17.645383 18655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:48:17.650698 18655 server_base.cc:1034] running on GCE node
W20260811 16:48:17.650669 18665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:17.650669 18666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:48:17.650653 18669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:48:17.651079 18655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:48:17.651368 18655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:48:17.652545 18655 hybrid_clock.cc:648] HybridClock initialized: now 1786466897652534 us; error 44 us; skew 500 ppm
Aug 11 16:48:17 dist-test-slave-3h5h krb5kdc[18097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466897, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:48:17.655200 18655 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:48:17.655686 18655 webserver.cc:460] Webserver started at http://127.2.55.131:41499/ using document root <none> and password file <none>
I20260811 16:48:17.655915 18655 fs_manager.cc:359] Metadata directory not provided
I20260811 16:48:17.655987 18655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:48:17.656147 18655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:48:17.657286 18655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "c6699384ea024125b8f4c4b3bd359a4f"
format_stamp: "Formatted at 2026-08-11 16:48:17 on dist-test-slave-3h5h"
server_key: "17aa4ee1cfad9b9fb54660367f8b5f33"
server_key_iv: "ab06df44c0ebe18202ca90c8c52a1ecb"
server_key_version: "encryptionkey@0"
I20260811 16:48:17.657712 18655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "c6699384ea024125b8f4c4b3bd359a4f"
format_stamp: "Formatted at 2026-08-11 16:48:17 on dist-test-slave-3h5h"
server_key: "17aa4ee1cfad9b9fb54660367f8b5f33"
server_key_iv: "ab06df44c0ebe18202ca90c8c52a1ecb"
server_key_version: "encryptionkey@0"
I20260811 16:48:17.659264 18655 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:48:17.660161 18679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:17.660355 18655 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:48:17.660470 18655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "c6699384ea024125b8f4c4b3bd359a4f"
format_stamp: "Formatted at 2026-08-11 16:48:17 on dist-test-slave-3h5h"
server_key: "17aa4ee1cfad9b9fb54660367f8b5f33"
server_key_iv: "ab06df44c0ebe18202ca90c8c52a1ecb"
server_key_version: "encryptionkey@0"
I20260811 16:48:17.660545 18655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:48:17.679373 18655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:48:17.681972 18655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:48:17.682149 18655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:48:17.682406 18655 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:48:17.682732 18655 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:48:17.682787 18655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:17.682833 18655 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:48:17.682858 18655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:48:17.689404 18655 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:43409
I20260811 16:48:17.689448 18860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:43409 every 8 connection(s)
I20260811 16:48:17.689786 18655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:48:17.693184 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 18655
I20260811 16:48:17.693277 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:48:17.693480 2270 external_mini_cluster.cc:1428] Setting key 3d8064cbe587b1b59f6c4a1c55a17519
Aug 11 16:48:17 dist-test-slave-3h5h krb5kdc[18097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466897, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:48:17.700209 18233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.690460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:43923 (local address 127.2.55.190:41807)
0811 16:48:17.690546 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:17.690548 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:17.690789 (+ 241us) server_negotiation.cc:407] Connection header received
0811 16:48:17.691357 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:17.691358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:17.691373 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:17.691421 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:17.692413 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.693021 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.694532 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.694817 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.694894 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.697640 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:48:17.697642 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:48:17.697642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:48:17.697649 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:48:17.698948 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:48:17.699360 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:48:17.699361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:48:17.699362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:48:17.699423 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:48:17.699661 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:48:17.699661 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:48:17.699662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:48:17.699774 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:48:17.699829 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:17.700068 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 16:48:17.700142 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:48:17.700371 18864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.690451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:41807 (local address 127.2.55.131:43923)
0811 16:48:17.690615 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:17.690689 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:17.691236 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:17.691508 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:17.691511 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:17.692099 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:48:17.692306 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:17.692310 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.693131 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.693133 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:17.694459 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:17.694462 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.694902 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.694903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:17.695008 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.695592 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:48:17.695604 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:48:17.697544 (+ 1940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:48:17.699024 (+ 1480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:48:17.699030 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:48:17.699032 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:48:17.699255 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:48:17.699490 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:48:17.699491 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:48:17.699491 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:48:17.699596 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:48:17.699831 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:48:17.699836 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:48:17.699955 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 16:48:17.700037 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 16:48:17.700165 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":69,"threads_started":1}
I20260811 16:48:17.700891 18862 heartbeater.cc:347] Connected to a master server at 127.2.55.190:41807
I20260811 16:48:17.700990 18862 heartbeater.cc:464] Registering TS with master...
I20260811 16:48:17.701196 18862 heartbeater.cc:511] Master 127.2.55.190:41807 requested a full tablet report, sending...
I20260811 16:48:17.701637 18158 ts_manager.cc:194] Registered new tserver with Master: c6699384ea024125b8f4c4b3bd359a4f (127.2.55.131:43409)
I20260811 16:48:17.702023 18158 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:43923
I20260811 16:48:17.705353 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:48:17.714313 18233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.706970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60010 (local address 127.2.55.190:41807)
0811 16:48:17.707055 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:17.707057 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:17.707179 (+ 122us) server_negotiation.cc:407] Connection header received
0811 16:48:17.707302 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:17.707303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:17.707317 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:17.707389 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:48:17.708100 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.708656 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.709577 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.709832 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.709939 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.711405 (+ 1466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:48:17.711407 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:48:17.711407 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:48:17.711416 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:48:17.712757 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:48:17.713232 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:48:17.713234 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:48:17.713234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:48:17.713310 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:48:17.713558 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:48:17.713560 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:48:17.713560 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:48:17.713773 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:48:17.713907 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:17.714096 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 16:48:17.714192 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 16:48:17.716135 18158 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60010:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:48:17.718264 18158 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:48:17.725062 18886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.720921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54148 (local address 127.2.55.130:34689)
0811 16:48:17.721234 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:17.721240 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:17.721250 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:48:17.721297 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:17.721299 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:17.721316 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:17.721715 (+ 399us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:48:17.721794 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.722892 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.724132 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.724615 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.724716 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.724778 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:17.724946 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 16:48:17.724986 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":92,"threads_started":1}
I20260811 16:48:17.725054 18884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.720788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:34689 (local address 127.0.0.1:54148)
0811 16:48:17.720969 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:17.721010 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:17.721073 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:17.721428 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:17.721431 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:17.721434 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:48:17.721504 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:17.721506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.723006 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.723007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:17.724046 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:17.724048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.724716 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.724717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:17.724809 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.724824 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 16:48:17.724921 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 16:48:17.724966 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":3,"thread_start_us":99,"threads_started":1}
I20260811 16:48:17.725135 18883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.721004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:41783 (local address 127.0.0.1:40652)
0811 16:48:17.721243 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:17.721253 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:17.721297 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:17.721622 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:17.721623 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:17.721626 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:48:17.721664 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:17.721665 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.723053 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.723054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:17.724006 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:17.724008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.724958 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.724959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:17.725011 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.725015 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:48:17.725044 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 16:48:17.725076 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":90,"threads_started":1}
I20260811 16:48:17.725066 18887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.720788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:43409 (local address 127.0.0.1:36446)
0811 16:48:17.721131 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:17.721166 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:17.721225 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:17.721559 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:17.721560 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:17.721562 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:48:17.721613 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:17.721615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.722585 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.722586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:17.723820 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:17.723823 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.724754 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.724756 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:17.724821 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.724826 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:48:17.724902 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 16:48:17.724971 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"mutex_wait_us":24,"thread_start_us":71,"threads_started":1}
I20260811 16:48:17.725342 18888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.721014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36446 (local address 127.2.55.131:43409)
0811 16:48:17.721366 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:17.721371 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:17.721382 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:48:17.721423 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:17.721425 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:17.721441 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:17.721553 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:48:17.721703 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.722467 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.723905 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.724648 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.725120 (+ 472us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.725190 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:17.725218 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 16:48:17.725268 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":79,"threads_started":1}
I20260811 16:48:17.725500 18889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.721266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40652 (local address 127.2.55.129:41783)
0811 16:48:17.721428 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:17.721432 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:17.721441 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:48:17.721504 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:17.721505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:17.721521 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:17.721798 (+ 277us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:48:17.721875 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.722933 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.724124 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.724866 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.725295 (+ 429us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.725357 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:17.725382 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 16:48:17.725427 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":87,"threads_started":1}
I20260811 16:48:17.726048 18761 tablet_service.cc:1467] Processing CreateTablet for tablet 00c9d5d5c9f1454884e5a83dbf84ea43 (DEFAULT_TABLE table=test-table [id=e7f4aebbd4dd43f494480545d693200c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:48:17.726308 18352 tablet_service.cc:1467] Processing CreateTablet for tablet 00c9d5d5c9f1454884e5a83dbf84ea43 (DEFAULT_TABLE table=test-table [id=e7f4aebbd4dd43f494480545d693200c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:48:17.726435 18761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c9d5d5c9f1454884e5a83dbf84ea43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:48:17.726691 18352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c9d5d5c9f1454884e5a83dbf84ea43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:48:17.726681 18554 tablet_service.cc:1467] Processing CreateTablet for tablet 00c9d5d5c9f1454884e5a83dbf84ea43 (DEFAULT_TABLE table=test-table [id=e7f4aebbd4dd43f494480545d693200c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:48:17.726995 18554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00c9d5d5c9f1454884e5a83dbf84ea43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:48:17.729497 18890 tablet_bootstrap.cc:492] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635: Bootstrap starting.
I20260811 16:48:17.730098 18891 tablet_bootstrap.cc:492] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f: Bootstrap starting.
I20260811 16:48:17.730319 18890 tablet_bootstrap.cc:654] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635: Neither blocks nor log segments found. Creating new log.
I20260811 16:48:17.730607 18892 tablet_bootstrap.cc:492] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee: Bootstrap starting.
I20260811 16:48:17.730937 18891 tablet_bootstrap.cc:654] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f: Neither blocks nor log segments found. Creating new log.
I20260811 16:48:17.731005 18890 log.cc:824] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635: Log is configured to *not* fsync() on all Append() calls
I20260811 16:48:17.731266 18892 tablet_bootstrap.cc:654] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee: Neither blocks nor log segments found. Creating new log.
I20260811 16:48:17.731509 18891 log.cc:824] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:48:17.731860 18892 log.cc:824] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee: Log is configured to *not* fsync() on all Append() calls
I20260811 16:48:17.731918 18890 tablet_bootstrap.cc:492] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635: No bootstrap required, opened a new log
I20260811 16:48:17.732005 18890 ts_tablet_manager.cc:1397] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:48:17.732303 18891 tablet_bootstrap.cc:492] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f: No bootstrap required, opened a new log
I20260811 16:48:17.732373 18891 ts_tablet_manager.cc:1397] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:48:17.732627 18892 tablet_bootstrap.cc:492] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee: No bootstrap required, opened a new log
I20260811 16:48:17.732688 18892 ts_tablet_manager.cc:1397] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:48:17.733887 18891 raft_consensus.cc:348] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6699384ea024125b8f4c4b3bd359a4f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43409 } } peers { permanent_uuid: "7b8c8aa258a649099495317e5fa16cee" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34689 } } peers { permanent_uuid: "251b6738a29b4eea861062d13adc3635" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41783 } }
I20260811 16:48:17.734010 18891 raft_consensus.cc:374] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:48:17.734031 18891 raft_consensus.cc:729] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6699384ea024125b8f4c4b3bd359a4f, State: Initialized, Role: FOLLOWER
I20260811 16:48:17.734051 18890 raft_consensus.cc:348] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6699384ea024125b8f4c4b3bd359a4f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43409 } } peers { permanent_uuid: "7b8c8aa258a649099495317e5fa16cee" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34689 } } peers { permanent_uuid: "251b6738a29b4eea861062d13adc3635" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41783 } }
I20260811 16:48:17.734160 18891 consensus_queue.cc:260] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6699384ea024125b8f4c4b3bd359a4f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43409 } } peers { permanent_uuid: "7b8c8aa258a649099495317e5fa16cee" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34689 } } peers { permanent_uuid: "251b6738a29b4eea861062d13adc3635" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41783 } }
I20260811 16:48:17.734205 18890 raft_consensus.cc:374] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:48:17.734239 18890 raft_consensus.cc:729] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 251b6738a29b4eea861062d13adc3635, State: Initialized, Role: FOLLOWER
I20260811 16:48:17.734364 18890 consensus_queue.cc:260] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6699384ea024125b8f4c4b3bd359a4f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43409 } } peers { permanent_uuid: "7b8c8aa258a649099495317e5fa16cee" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34689 } } peers { permanent_uuid: "251b6738a29b4eea861062d13adc3635" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41783 } }
I20260811 16:48:17.734434 18891 ts_tablet_manager.cc:1428] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:48:17.734444 18862 heartbeater.cc:503] Master 127.2.55.190:41807 was elected leader, sending a full tablet report...
I20260811 16:48:17.734627 18890 ts_tablet_manager.cc:1428] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:48:17.734772 18446 heartbeater.cc:503] Master 127.2.55.190:41807 was elected leader, sending a full tablet report...
I20260811 16:48:17.734719 18892 raft_consensus.cc:348] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6699384ea024125b8f4c4b3bd359a4f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43409 } } peers { permanent_uuid: "7b8c8aa258a649099495317e5fa16cee" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34689 } } peers { permanent_uuid: "251b6738a29b4eea861062d13adc3635" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41783 } }
I20260811 16:48:17.734874 18892 raft_consensus.cc:374] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:48:17.734907 18892 raft_consensus.cc:729] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8c8aa258a649099495317e5fa16cee, State: Initialized, Role: FOLLOWER
I20260811 16:48:17.735002 18892 consensus_queue.cc:260] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6699384ea024125b8f4c4b3bd359a4f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43409 } } peers { permanent_uuid: "7b8c8aa258a649099495317e5fa16cee" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34689 } } peers { permanent_uuid: "251b6738a29b4eea861062d13adc3635" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41783 } }
I20260811 16:48:17.735265 18892 ts_tablet_manager.cc:1428] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:48:17.735342 18649 heartbeater.cc:503] Master 127.2.55.190:41807 was elected leader, sending a full tablet report...
W20260811 16:48:17.770884 18650 tablet.cc:2369] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:48:17.853652 18447 tablet.cc:2369] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:48:17.940341 18863 tablet.cc:2369] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:48:17.946715 18899 raft_consensus.cc:482] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:48:17.946851 18899 raft_consensus.cc:504] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6699384ea024125b8f4c4b3bd359a4f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43409 } } peers { permanent_uuid: "7b8c8aa258a649099495317e5fa16cee" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34689 } } peers { permanent_uuid: "251b6738a29b4eea861062d13adc3635" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41783 } }
I20260811 16:48:17.947290 18899 leader_election.cc:288] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6699384ea024125b8f4c4b3bd359a4f (127.2.55.131:43409), 251b6738a29b4eea861062d13adc3635 (127.2.55.129:41783)
I20260811 16:48:17.951386 18889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.947901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:48223 (local address 127.2.55.129:41783)
0811 16:48:17.947947 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:17.947949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:17.948068 (+ 119us) server_negotiation.cc:407] Connection header received
0811 16:48:17.948136 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:17.948137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:17.948151 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:17.948206 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:48:17.948382 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.949078 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.950371 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.950947 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.951026 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.951036 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:17.951276 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 16:48:17.951316 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:48:17.951386 18888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.947690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:37513 (local address 127.2.55.131:43409)
0811 16:48:17.947755 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:17.947758 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:17.947805 (+ 47us) server_negotiation.cc:407] Connection header received
0811 16:48:17.947837 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:17.947838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:17.947849 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:17.947896 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:48:17.948112 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.948917 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.950372 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.950948 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.951027 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.951036 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:17.951275 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 16:48:17.951316 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 16:48:17.951396 18651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.947586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:43409 (local address 127.2.55.130:37513)
0811 16:48:17.947665 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:17.947680 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:17.947753 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:17.947946 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:17.947948 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:17.947950 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:48:17.948026 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:17.948028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.949045 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.949046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:17.950268 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:17.950271 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.951088 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.951089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:17.951177 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.951183 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:48:17.951248 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 16:48:17.951303 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":7}
I20260811 16:48:17.951404 18900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:17.947776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:41783 (local address 127.2.55.130:48223)
0811 16:48:17.947975 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:17.947984 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:48:17.948076 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:48:17.948214 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:48:17.948215 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:48:17.948216 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:48:17.948297 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:17.948298 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.949153 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.949154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:17.950268 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:48:17.950271 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:48:17.951088 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:48:17.951089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:48:17.951177 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:17.951184 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 16:48:17.951271 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 16:48:17.951303 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":4,"thread_start_us":120,"threads_started":1}
I20260811 16:48:17.951872 18789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c9d5d5c9f1454884e5a83dbf84ea43" candidate_uuid: "7b8c8aa258a649099495317e5fa16cee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6699384ea024125b8f4c4b3bd359a4f" is_pre_election: true
I20260811 16:48:17.952075 18789 raft_consensus.cc:2454] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b8c8aa258a649099495317e5fa16cee in term 0.
I20260811 16:48:17.952116 18384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c9d5d5c9f1454884e5a83dbf84ea43" candidate_uuid: "7b8c8aa258a649099495317e5fa16cee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "251b6738a29b4eea861062d13adc3635" is_pre_election: true
I20260811 16:48:17.952309 18384 raft_consensus.cc:2454] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b8c8aa258a649099495317e5fa16cee in term 0.
I20260811 16:48:17.952348 18483 leader_election.cc:302] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c8aa258a649099495317e5fa16cee, c6699384ea024125b8f4c4b3bd359a4f; no voters:
I20260811 16:48:17.952481 18899 raft_consensus.cc:2781] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:48:17.952565 18899 raft_consensus.cc:482] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:48:17.952596 18899 raft_consensus.cc:3037] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:48:17.953372 18899 raft_consensus.cc:504] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6699384ea024125b8f4c4b3bd359a4f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43409 } } peers { permanent_uuid: "7b8c8aa258a649099495317e5fa16cee" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34689 } } peers { permanent_uuid: "251b6738a29b4eea861062d13adc3635" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41783 } }
I20260811 16:48:17.953514 18899 leader_election.cc:288] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [CANDIDATE]: Term 1 election: Requested vote from peers c6699384ea024125b8f4c4b3bd359a4f (127.2.55.131:43409), 251b6738a29b4eea861062d13adc3635 (127.2.55.129:41783)
I20260811 16:48:17.953660 18789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c9d5d5c9f1454884e5a83dbf84ea43" candidate_uuid: "7b8c8aa258a649099495317e5fa16cee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6699384ea024125b8f4c4b3bd359a4f"
I20260811 16:48:17.953691 18384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00c9d5d5c9f1454884e5a83dbf84ea43" candidate_uuid: "7b8c8aa258a649099495317e5fa16cee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "251b6738a29b4eea861062d13adc3635"
I20260811 16:48:17.953753 18789 raft_consensus.cc:3037] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:48:17.953786 18384 raft_consensus.cc:3037] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:48:17.954509 18789 raft_consensus.cc:2454] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c8aa258a649099495317e5fa16cee in term 1.
I20260811 16:48:17.954594 18384 raft_consensus.cc:2454] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c8aa258a649099495317e5fa16cee in term 1.
I20260811 16:48:17.954687 18483 leader_election.cc:302] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c8aa258a649099495317e5fa16cee, c6699384ea024125b8f4c4b3bd359a4f; no voters:
I20260811 16:48:17.954803 18899 raft_consensus.cc:2781] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:48:17.954973 18899 raft_consensus.cc:686] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [term 1 LEADER]: Becoming Leader. State: Replica: 7b8c8aa258a649099495317e5fa16cee, State: Running, Role: LEADER
I20260811 16:48:17.955107 18899 consensus_queue.cc:237] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6699384ea024125b8f4c4b3bd359a4f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43409 } } peers { permanent_uuid: "7b8c8aa258a649099495317e5fa16cee" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34689 } } peers { permanent_uuid: "251b6738a29b4eea861062d13adc3635" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41783 } }
I20260811 16:48:17.956085 18158 catalog_manager.cc:5495] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b8c8aa258a649099495317e5fa16cee (127.2.55.130). New cstate: current_term: 1 leader_uuid: "7b8c8aa258a649099495317e5fa16cee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6699384ea024125b8f4c4b3bd359a4f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c8aa258a649099495317e5fa16cee" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "251b6738a29b4eea861062d13adc3635" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41783 } health_report { overall_health: UNKNOWN } } }
I20260811 16:48:18.009549 18886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:18.006913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54162 (local address 127.2.55.130:34689)
0811 16:48:18.006997 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 16:48:18.007062 (+ 65us) server_negotiation.cc:399] Waiting for connection header
0811 16:48:18.007072 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:48:18.007114 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:48:18.007114 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:48:18.007138 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:48:18.007231 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:48:18.007356 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:18.007835 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:18.008700 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:48:18.008969 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:48:18.009035 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:48:18.009227 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:48:18.009338 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:48:18.009405 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:48:18.009441 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 16:48:18.009462 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 16:48:18.011399 18384 raft_consensus.cc:1261] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635 [term 1 FOLLOWER]: Refusing update from remote peer 7b8c8aa258a649099495317e5fa16cee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:48:18.011454 18789 raft_consensus.cc:1261] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f [term 1 FOLLOWER]: Refusing update from remote peer 7b8c8aa258a649099495317e5fa16cee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:48:18.011796 18899 consensus_queue.cc:1035] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [LEADER]: Connected to new peer: Peer: permanent_uuid: "251b6738a29b4eea861062d13adc3635" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:48:18.011969 18901 consensus_queue.cc:1035] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6699384ea024125b8f4c4b3bd359a4f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:48:18.014724 18907 mvcc.cc:205] Tried to move back new op lower bound from 7317368414251945984 to 7317368414024744960. Current Snapshot: MvccSnapshot[applied={T|T < 7317368414251945984}]
I20260811 16:48:18.015674 18906 mvcc.cc:205] Tried to move back new op lower bound from 7317368414251945984 to 7317368414024744960. Current Snapshot: MvccSnapshot[applied={T|T < 7317368414251945984 or (T in {7317368414251945984})}]
I20260811 16:48:18.016901 18156 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:48:18.017006 18156 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:48:18.017820 18156 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 35bba8ba12754c899f7b30e23d3ab8b4: Sending DeleteTablet for 3 replicas of tablet 00c9d5d5c9f1454884e5a83dbf84ea43
I20260811 16:48:18.018142 18554 tablet_service.cc:1514] Processing DeleteTablet for tablet 00c9d5d5c9f1454884e5a83dbf84ea43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:48:18 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:54148
I20260811 16:48:18.018151 18761 tablet_service.cc:1514] Processing DeleteTablet for tablet 00c9d5d5c9f1454884e5a83dbf84ea43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:48:18 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:36446
I20260811 16:48:18.018190 18352 tablet_service.cc:1514] Processing DeleteTablet for tablet 00c9d5d5c9f1454884e5a83dbf84ea43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:48:18 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:40652
I20260811 16:48:18.018378 18922 tablet_replica.cc:330] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f: stopping tablet replica
I20260811 16:48:18.018488 18922 raft_consensus.cc:2229] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:48:18.018537 18925 tablet_replica.cc:330] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635: stopping tablet replica
I20260811 16:48:18.018597 18922 raft_consensus.cc:2258] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:48:18.018621 18925 raft_consensus.cc:2229] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:48:18.018791 18925 raft_consensus.cc:2258] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 251b6738a29b4eea861062d13adc3635 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:48:18.018842 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 18257
I20260811 16:48:18.031890 18922 ts_tablet_manager.cc:1905] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:48:18.034065 18922 ts_tablet_manager.cc:1918] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:48:18.034283 18922 log.cc:1196] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/00c9d5d5c9f1454884e5a83dbf84ea43
I20260811 16:48:18.034693 18922 ts_tablet_manager.cc:1939] T 00c9d5d5c9f1454884e5a83dbf84ea43 P c6699384ea024125b8f4c4b3bd359a4f: Deleting consensus metadata
I20260811 16:48:18.037564 18142 catalog_manager.cc:4841] TS c6699384ea024125b8f4c4b3bd359a4f (127.2.55.131:43409): tablet 00c9d5d5c9f1454884e5a83dbf84ea43 (table test-table [id=e7f4aebbd4dd43f494480545d693200c]) successfully deleted
I20260811 16:48:18.043337 18921 tablet_replica.cc:330] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee: stopping tablet replica
W20260811 16:48:18.043322 18142 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.55.129:41783 (error 108)
I20260811 16:48:18.043848 18921 raft_consensus.cc:2229] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:48:18.043942 18887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:18.043794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:41783 (local address 127.0.0.1:40654)
0811 16:48:18.043853 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:18.043894 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:41783: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 16:48:18.044009 18921 raft_consensus.cc:2258] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 16:48:18.044076 18142 catalog_manager.cc:4584] TS 251b6738a29b4eea861062d13adc3635 (127.2.55.129:41783): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 00c9d5d5c9f1454884e5a83dbf84ea43: Network error: Client connection negotiation failed: client connection to 127.2.55.129:41783: connect: Connection refused (error 111)
I20260811 16:48:18.044570 18921 ts_tablet_manager.cc:1905] T 00c9d5d5c9f1454884e5a83dbf84ea43 P 7b8c8aa258a649099495317e5fa16cee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:48:18.044576 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 18452
I20260811 16:48:18.065310 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 18655
I20260811 16:48:18.065426 18887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:48:18.065271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:34689 (local address 127.0.0.1:54170)
0811 16:48:18.065340 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 16:48:18.065376 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.130:34689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 16:48:18.076390 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 18116
2026-08-11T16:48:18Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2546 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:48:18 dist-test-slave-3h5h krb5kdc[18931](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:48:18 dist-test-slave-3h5h krb5kdc[18931](info): set up 2 sockets
Aug 11 16:48:18 dist-test-slave-3h5h krb5kdc[18931](info): commencing operation
krb5kdc: starting...
W20260811 16:48:19.363763 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:48:19 dist-test-slave-3h5h krb5kdc[18931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466899, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:48:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:48:19Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.2.55.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.2.55.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.2.55.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/rangeradmin_127.2.55.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.2.55.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/rangeradmin_127.2.55.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.2.55.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.2.55.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.2.55.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/rangerlookup_127.2.55.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.2.55.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/rangerlookup_127.2.55.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.2.55.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.2.55.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.2.55.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/HTTP_127.2.55.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.2.55.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/HTTP_127.2.55.148@KRBTEST.COM.keytab.
I20260811 16:48:19.625841 2270 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskCmcTbT/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/postgres -l logfile start
2026-08-11 16:48:22.783 UTC [18986] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 16:48:22.784 UTC [18986] LOG: listening on IPv4 address "127.2.55.148", port 36463
2026-08-11 16:48:22.789 UTC [18986] LOG: listening on Unix socket "/tmp/.s.PGSQL.36463"
2026-08-11 16:48:22.827 UTC [18990] LOG: database system was shut down at 2026-08-11 16:48:21 UTC
2026-08-11 16:48:22.831 UTC [18986] LOG: database system is ready to accept connections
I20260811 16:48:24.007756 2270 mini_postgres.cc:96] Postgres bound to 36463
2026-08-11 16:48:24.017 UTC [19000] FATAL: database "slave" does not exist
127.2.55.148:36463 - accepting connections
I20260811 16:48:24.018406 2270 mini_ranger.cc:161] Starting Ranger...
I20260811 16:48:24.036281 2270 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 16:48:24.635195 2270 mini_ranger.cc:87] Created ranger Postgres database
I20260811 16:48:24.635289 2270 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-admin
2026-08-11 16:48:24,968 [I] DB FLAVOR :POSTGRES
2026-08-11 16:48:24,969 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 16:48:24,969 [I] Checking connection..
2026-08-11 16:48:24,969 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 16:48:25,249 [I] Checking connection passed.
2026-08-11 16:48:25,249 [I] --------- Verifying version history table ---------
2026-08-11 16:48:25,249 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:48:25,527 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 16:48:25,527 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:48:25,785 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 16:48:25,785 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 16:48:25,785 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 16:48:26.048 UTC [19086] WARNING: there is no transaction in progress
2026-08-11 16:48:26,057 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 16:48:26,058 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:48:26,309 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 16:48:26,309 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 16:48:26,310 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 16:48:26,588 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 16:48:26,839 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-3h5h.c.gcp-upstream.internal','N') ;"
2026-08-11 16:48:27,113 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 16:48:27,371 [I] Table x_portal_user does not exist in database ranger
2026-08-11 16:48:27,372 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 16:48:27,631 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 16:48:27,631 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 16:48:27,886 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 16:48:28,149 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 16:48:28,149 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 16:48:29.208 UTC [19250] WARNING: there is no transaction in progress
2026-08-11 16:48:29.227 UTC [19250] WARNING: there is no transaction in progress
2026-08-11 16:48:29.245 UTC [19250] WARNING: there is no transaction in progress
2026-08-11 16:48:29.265 UTC [19250] WARNING: there is no transaction in progress
2026-08-11 16:48:29.286 UTC [19250] WARNING: there is no transaction in progress
2026-08-11 16:48:29.307 UTC [19250] WARNING: there is no transaction in progress
2026-08-11 16:48:29.378 UTC [19250] WARNING: there is no transaction in progress
2026-08-11 16:48:29.387 UTC [19250] WARNING: there is no transaction in progress
2026-08-11 16:48:29.404 UTC [19250] WARNING: there is no transaction in progress
2026-08-11 16:48:29.416 UTC [19250] WARNING: there is no transaction in progress
2026-08-11 16:48:29.429 UTC [19250] WARNING: there is no transaction in progress
2026-08-11 16:48:29.443 UTC [19250] WARNING: there is no transaction in progress
2026-08-11 16:48:29.453 UTC [19250] WARNING: there is no transaction in progress
2026-08-11 16:48:29.460 UTC [19250] WARNING: there is no transaction in progress
2026-08-11 16:48:29.469 UTC [19250] WARNING: there is no transaction in progress
2026-08-11 16:48:29.477 UTC [19250] WARNING: there is no transaction in progress
2026-08-11 16:48:30,232 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 16:48:30,233 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 16:48:30,508 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 16:48:30,508 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 16:48:30,756 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 16:48:30,757 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 16:48:31,040 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 16:48:31,040 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 16:48:31,341 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 16:48:31,590 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-3h5h.c.gcp-upstream.internal';"
2026-08-11 16:48:31,860 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 16:48:31,860 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 16:48:32,118 [I] DB_PATCHES have already been applied
I20260811 16:48:32.125054 2270 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-admin:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskCmcTbT/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 16:48:32.125129 2270 mini_ranger.cc:193] Using host: 127.2.55.148
I20260811 16:48:32.129683 2270 mini_ranger.cc:227] Ranger admin URL: http://127.2.55.148:34891
Aug 11, 2026 4:48:32 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 4:48:32 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 4:48:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 4:48:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 4:48:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 4:48:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 4:48:33 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 16:48:33.605334 2270 mini_ranger.cc:160] Time spent starting Ranger: real 9.587s user 0.000s sys 0.013s
Aug 11, 2026 4:48:55 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 4:48:55 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 4:48:55 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 4:48:55 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 4:48:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 4:48:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 4:48:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 4:48:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 4:48:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 4:48:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 4:48:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 4:48:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 4:48:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 4:48:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 4:48:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 4:48:55 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 4:48:55 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 4:48:56 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 16:48:57.210384 2270 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.2.55.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.2.55.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.2.55.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/rangerkms_127.2.55.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.2.55.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/rangerkms_127.2.55.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.2.55.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.2.55.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.2.55.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/HTTP_127.2.55.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.2.55.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/HTTP_127.2.55.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 16:48:57 dist-test-slave-3h5h krb5kdc[18931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466937, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 16:48:57.329337 2270 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 16:48:57.341660 2270 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 16:48:58.294410 2270 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 16:48:58.294517 2270 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-kms
I20260811 16:48:58.294538 2270 mini_ranger_kms.cc:227] Using postgres at 127.2.55.148:36463
2026-08-11 16:48:58,781 [I] DB FLAVOR :POSTGRES
2026-08-11 16:48:58,782 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 16:48:58,782 [I] Checking connection
2026-08-11 16:48:58,782 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 16:48:59,100 [I] connection success
2026-08-11 16:48:59,100 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 16:48:59,100 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 16:48:59,100 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 16:48:59,366 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 16:48:59,367 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 16:48:59,367 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 16:48:59,367 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:36463/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 16:48:59,643 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 16:49:00.146318 2270 mini_ranger_kms.cc:310] Created kms service
I20260811 16:49:00.377835 2270 mini_ranger_kms.cc:326] Created kudu user
I20260811 16:49:00.421599 2270 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 16:49:00 dist-test-slave-3h5h krb5kdc[18931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466937, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
I20260811 16:49:00.842281 2270 mini_ranger_kms.cc:384] Added ranger policy
I20260811 16:49:00.842404 2270 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-kms:/tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 16:49:00.842432 2270 mini_ranger_kms.cc:240] Using host: 127.2.55.148
I20260811 16:49:00.847277 2270 mini_ranger_kms.cc:276] Ranger KMS PID: 19539
I20260811 16:49:00.847409 2270 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.2.55.148:59063
Aug 11, 2026 4:49:02 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 4:49:02 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 4:49:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 4:49:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 4:49:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 4:49:02 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 16:49:03 dist-test-slave-3h5h krb5kdc[18931](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786466943, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.2.55.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:49:03.663312 2270 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.334s user 0.019s sys 0.375s
I20260811 16:49:03.663441 2270 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 16:49:03.663543 2270 mini_ranger_kms.cc:401] 127.2.55.148:59063/kms/v1/keys
Aug 11 16:49:04 dist-test-slave-3h5h krb5kdc[18931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466943, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.2.55.148@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
Aug 11 16:49:04 dist-test-slave-3h5h krb5kdc[18931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466943, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.2.55.148@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
Aug 11 16:49:06 dist-test-slave-3h5h krb5kdc[18931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466946, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:49:07.028968 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:41029
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:41029
--ranger_config_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.55.148:59063/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:49:07.120433 19609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:49:07.120652 19609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:49:07.120675 19609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:49:07.121958 19609 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:49:07.122004 19609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:49:07.122018 19609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:49:07.122030 19609 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:49:07.122042 19609 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:49:07.123694 19609 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/wal
--ranger_kms_url=127.2.55.148:59063/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:41029
--ranger_config_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:41029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:49:07.123963 19609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:49:07.124212 19609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:49:07.129733 19609 server_base.cc:1034] running on GCE node
W20260811 16:49:07.129838 19620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:07.129838 19619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:07.130142 19623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:07.130522 19609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:49:07.130853 19609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:49:07.132036 19609 hybrid_clock.cc:648] HybridClock initialized: now 1786466947132012 us; error 42 us; skew 500 ppm
Aug 11 16:49:07 dist-test-slave-3h5h krb5kdc[18931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466947, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:49:07.135007 19609 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:49:07.135492 19609 webserver.cc:460] Webserver started at http://127.2.55.190:34877/ using document root <none> and password file <none>
I20260811 16:49:07.135720 19609 fs_manager.cc:359] Metadata directory not provided
I20260811 16:49:07.135758 19609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:49:07.135900 19609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:49:07 dist-test-slave-3h5h krb5kdc[18931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466947, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
I20260811 16:49:07.183704 19609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "5a480d707d1b4ba9b7cfe3f395231678"
format_stamp: "Formatted at 2026-08-11 16:49:07 on dist-test-slave-3h5h"
server_key: "c60f4e029cbc74c3920bd2915f324c6e"
server_key_iv: "811e31555ccf32270c3794c7b479fbef"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:07.184172 19609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "5a480d707d1b4ba9b7cfe3f395231678"
format_stamp: "Formatted at 2026-08-11 16:49:07 on dist-test-slave-3h5h"
server_key: "c60f4e029cbc74c3920bd2915f324c6e"
server_key_iv: "811e31555ccf32270c3794c7b479fbef"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:07.186051 19609 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 16:49:07.202978 19635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:07.203282 19609 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:49:07.203411 19609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "5a480d707d1b4ba9b7cfe3f395231678"
format_stamp: "Formatted at 2026-08-11 16:49:07 on dist-test-slave-3h5h"
server_key: "c60f4e029cbc74c3920bd2915f324c6e"
server_key_iv: "811e31555ccf32270c3794c7b479fbef"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:07.203519 19609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:49:07.213980 19609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:49:07.216246 19609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:49:07.216414 19609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:49:07.222357 19609 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:41029
I20260811 16:49:07.222383 19704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:41029 every 8 connection(s)
I20260811 16:49:07.222889 19609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:49:07.223702 19706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:49:07.226277 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 19609
I20260811 16:49:07.226399 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:49:07.226660 2270 external_mini_cluster.cc:1428] Setting key ec256428b6965ee9b821f8bb75186644
I20260811 16:49:07.226768 19706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678: Bootstrap starting.
I20260811 16:49:07.227700 19706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678: Neither blocks nor log segments found. Creating new log.
I20260811 16:49:07.228122 19706 log.cc:824] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678: Log is configured to *not* fsync() on all Append() calls
I20260811 16:49:07.229255 19706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678: No bootstrap required, opened a new log
I20260811 16:49:07.231873 19706 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a480d707d1b4ba9b7cfe3f395231678" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41029 } }
I20260811 16:49:07.232059 19706 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:49:07.232136 19706 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a480d707d1b4ba9b7cfe3f395231678, State: Initialized, Role: FOLLOWER
I20260811 16:49:07.232326 19706 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a480d707d1b4ba9b7cfe3f395231678" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41029 } }
I20260811 16:49:07.232437 19706 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:49:07.232507 19706 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:49:07.232574 19706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:49:07.233458 19706 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a480d707d1b4ba9b7cfe3f395231678" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41029 } }
I20260811 16:49:07.233601 19706 leader_election.cc:302] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a480d707d1b4ba9b7cfe3f395231678; no voters:
I20260811 16:49:07.233834 19706 leader_election.cc:288] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:49:07.233863 19713 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:49:07.234122 19713 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [term 1 LEADER]: Becoming Leader. State: Replica: 5a480d707d1b4ba9b7cfe3f395231678, State: Running, Role: LEADER
I20260811 16:49:07.234313 19706 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 16:49:07 dist-test-slave-3h5h krb5kdc[18931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466946, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:49:07.234331 19713 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a480d707d1b4ba9b7cfe3f395231678" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41029 } }
I20260811 16:49:07.236702 19714 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a480d707d1b4ba9b7cfe3f395231678. Latest consensus state: current_term: 1 leader_uuid: "5a480d707d1b4ba9b7cfe3f395231678" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a480d707d1b4ba9b7cfe3f395231678" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41029 } } }
I20260811 16:49:07.237965 19714 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [sys.catalog]: This master's current role is: LEADER
I20260811 16:49:07.237357 19706 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 16:49:07.237886 19715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a480d707d1b4ba9b7cfe3f395231678" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a480d707d1b4ba9b7cfe3f395231678" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41029 } } }
I20260811 16:49:07.238751 19715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678 [sys.catalog]: This master's current role is: LEADER
I20260811 16:49:07.242767 19709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:07.227332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47684 (local address 127.2.55.190:41029)
0811 16:49:07.227513 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:07.227522 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:07.227566 (+ 44us) server_negotiation.cc:407] Connection header received
0811 16:49:07.228143 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:07.228154 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:07.228226 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:07.228394 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:49:07.229223 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:07.230588 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:07.231787 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:07.232398 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:07.232504 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:07.235751 (+ 3247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:49:07.235755 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:49:07.235755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:49:07.235767 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:49:07.237753 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:07.238340 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:07.238343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:07.238344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:07.238446 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:07.238702 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:07.238703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:07.238704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:07.241106 (+ 2402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:49:07.241707 (+ 601us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:07.241831 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 16:49:07.242358 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":69,"threads_started":1}
I20260811 16:49:07.238456 19736 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:49:07.244685 19736 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:49:07.247956 19736 catalog_manager.cc:1347] Generated new cluster ID: 074520ee5c394868badd8071b6077632
I20260811 16:49:07.248023 19736 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:49:07.284858 19736 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:49:07.285862 19736 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:49:07.296932 19736 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678: Generated new TSK 0
I20260811 16:49:07.297326 19736 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:49:08.052524 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.55.148:59063/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41029
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:49:08.160234 19782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:49:08.160497 19782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:49:08.160542 19782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:49:08.161929 19782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:49:08.162019 19782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:49:08.162073 19782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:49:08.163872 19782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.2.55.148:59063/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:49:08.164187 19782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:49:08.164469 19782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:49:08.171730 19791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:08.171814 19782 server_base.cc:1034] running on GCE node
W20260811 16:49:08.171814 19789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:08.172079 19787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:08.172361 19782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:49:08.172715 19782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:49:08.173916 19782 hybrid_clock.cc:648] HybridClock initialized: now 1786466948173908 us; error 44 us; skew 500 ppm
Aug 11 16:49:08 dist-test-slave-3h5h krb5kdc[18931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466948, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:49:08.177539 19782 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:49:08.178133 19782 webserver.cc:460] Webserver started at http://127.2.55.129:40075/ using document root <none> and password file <none>
I20260811 16:49:08.178421 19782 fs_manager.cc:359] Metadata directory not provided
I20260811 16:49:08.178505 19782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:49:08.178689 19782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:49:08 dist-test-slave-3h5h krb5kdc[18931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466948, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
I20260811 16:49:08.199841 19782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "acf7b2e42100479c81d9ce1f8767c556"
format_stamp: "Formatted at 2026-08-11 16:49:08 on dist-test-slave-3h5h"
server_key: "d5361717398f8a1ba196c3423c21b07c"
server_key_iv: "3b858a43a2690545462c3ec273ba1574"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:08.200476 19782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "acf7b2e42100479c81d9ce1f8767c556"
format_stamp: "Formatted at 2026-08-11 16:49:08 on dist-test-slave-3h5h"
server_key: "d5361717398f8a1ba196c3423c21b07c"
server_key_iv: "3b858a43a2690545462c3ec273ba1574"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:08.202800 19782 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 16:49:08.217810 19800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:08.218101 19782 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:49:08.218225 19782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "acf7b2e42100479c81d9ce1f8767c556"
format_stamp: "Formatted at 2026-08-11 16:49:08 on dist-test-slave-3h5h"
server_key: "d5361717398f8a1ba196c3423c21b07c"
server_key_iv: "3b858a43a2690545462c3ec273ba1574"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:08.218323 19782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:49:08.244455 19782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:49:08.246899 19782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:49:08.247130 19782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:49:08.247407 19782 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:49:08.247929 19782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:49:08.247993 19782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:08.248032 19782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:49:08.248085 19782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:08.256757 19782 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:33801
I20260811 16:49:08.257167 19983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:33801 every 8 connection(s)
I20260811 16:49:08.257329 19782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:49:08.261085 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 19782
I20260811 16:49:08.261220 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:49:08.261487 2270 external_mini_cluster.cc:1428] Setting key ff1c3d3d13a5a0318bbce968160b9a56
Aug 11 16:49:08 dist-test-slave-3h5h krb5kdc[18931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466948, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:49:08.271358 19989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:08.258740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:58307 (local address 127.2.55.190:41029)
0811 16:49:08.258908 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:08.258910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:08.258923 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:49:08.259388 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:08.259389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:08.259405 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:08.259507 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:49:08.260347 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.261229 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.262740 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.263112 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.263217 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:08.267888 (+ 4671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:49:08.267890 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:49:08.267891 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:49:08.267900 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:49:08.269760 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:08.270281 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:08.270282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:08.270283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:08.270351 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:08.270638 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:08.270639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:08.270640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:08.270770 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:49:08.270849 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:08.271152 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 16:49:08.271247 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":106,"threads_started":1}
I20260811 16:49:08.271574 19988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:08.258294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:41029 (local address 127.2.55.129:58307)
0811 16:49:08.258527 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:08.258584 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:08.259229 (+ 645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:08.259619 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:08.259624 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:08.259903 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:49:08.260220 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:08.260227 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.261356 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.261357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:08.262639 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:08.262642 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.263235 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.263237 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:08.263390 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:08.264372 (+ 982us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:49:08.264383 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:49:08.267746 (+ 3363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:49:08.269860 (+ 2114us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:08.269868 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:08.269872 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:08.270193 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:08.270422 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:08.270423 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:08.270423 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:08.270559 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:08.270840 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:49:08.270848 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:49:08.271007 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 16:49:08.271129 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 16:49:08.271295 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":104,"threads_started":1}
I20260811 16:49:08.272207 19984 heartbeater.cc:347] Connected to a master server at 127.2.55.190:41029
I20260811 16:49:08.272336 19984 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:08.272565 19984 heartbeater.cc:511] Master 127.2.55.190:41029 requested a full tablet report, sending...
I20260811 16:49:08.273175 19656 ts_manager.cc:194] Registered new tserver with Master: acf7b2e42100479c81d9ce1f8767c556 (127.2.55.129:33801)
I20260811 16:49:08.273810 19656 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:58307
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:49:08.301815 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.55.148:59063/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41029
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:49:08.430610 20000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:49:08.430990 20000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:49:08.431103 20000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:49:08.433234 20000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:49:08.433357 20000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:49:08.433570 20000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:49:08.436134 20000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.2.55.148:59063/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:49:08.436671 20000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:49:08.437072 20000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:49:08.444068 20013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:08.444329 20014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:08.445076 20000 server_base.cc:1034] running on GCE node
W20260811 16:49:08.445636 20017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:08.445921 20000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:49:08.446357 20000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:49:08.449730 20000 hybrid_clock.cc:648] HybridClock initialized: now 1786466948449702 us; error 41 us; skew 500 ppm
Aug 11 16:49:08 dist-test-slave-3h5h krb5kdc[18931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466948, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:49:08.453387 20000 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:49:08.453982 20000 webserver.cc:460] Webserver started at http://127.2.55.130:45531/ using document root <none> and password file <none>
I20260811 16:49:08.454296 20000 fs_manager.cc:359] Metadata directory not provided
I20260811 16:49:08.454401 20000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:49:08.454577 20000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:49:08 dist-test-slave-3h5h krb5kdc[18931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466948, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
I20260811 16:49:08.472817 20000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "65fc31ecf3864fe5ba9e3d223e31d469"
format_stamp: "Formatted at 2026-08-11 16:49:08 on dist-test-slave-3h5h"
server_key: "ad26f8ef2fb72b2c66b5393a933d4561"
server_key_iv: "d9aa4ac154e22996189993f863ee7638"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:08.473390 20000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "65fc31ecf3864fe5ba9e3d223e31d469"
format_stamp: "Formatted at 2026-08-11 16:49:08 on dist-test-slave-3h5h"
server_key: "ad26f8ef2fb72b2c66b5393a933d4561"
server_key_iv: "d9aa4ac154e22996189993f863ee7638"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:08.484386 20000 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.003s sys 0.000s
Aug 11 16:49:08 dist-test-slave-3h5h krb5kdc[18931](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786466948, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:49:08.526870 20026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:08.527671 20000 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:49:08.527803 20000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "65fc31ecf3864fe5ba9e3d223e31d469"
format_stamp: "Formatted at 2026-08-11 16:49:08 on dist-test-slave-3h5h"
server_key: "ad26f8ef2fb72b2c66b5393a933d4561"
server_key_iv: "d9aa4ac154e22996189993f863ee7638"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:08.527922 20000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:49:08.576534 20000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:49:08.580751 20000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:49:08.581085 20000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:49:08.581451 20000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:49:08.582176 20000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:49:08.582295 20000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:08.582383 20000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:49:08.582458 20000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:08.594612 20000 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:37559
I20260811 16:49:08.595273 20000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:49:08.597905 20207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:37559 every 8 connection(s)
I20260811 16:49:08.599858 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 20000
I20260811 16:49:08.599977 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:49:08.600195 2270 external_mini_cluster.cc:1428] Setting key 870cd2c5059d01064c9f1310b9176f4b
Aug 11 16:49:08 dist-test-slave-3h5h krb5kdc[18931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466948, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:49:08.616166 19989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:08.599258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:36717 (local address 127.2.55.190:41029)
0811 16:49:08.599309 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:08.599311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:08.599558 (+ 247us) server_negotiation.cc:407] Connection header received
0811 16:49:08.601191 (+ 1633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:08.601192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:08.601210 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:08.601242 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:49:08.606937 (+ 5695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.607811 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.609479 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.609791 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.609835 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:08.612666 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:49:08.612668 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:49:08.612668 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:49:08.612677 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:49:08.614514 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:08.615017 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:08.615018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:08.615019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:08.615079 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:08.615342 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:08.615343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:08.615343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:08.615478 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:49:08.615537 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:08.615957 (+ 420us) server_negotiation.cc:299] Negotiation successful
0811 16:49:08.616072 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:49:08.617221 20211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:08.598897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:41029 (local address 127.2.55.130:36717)
0811 16:49:08.599430 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:08.599475 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:08.600424 (+ 949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:08.601442 (+ 1018us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:08.601447 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:08.606443 (+ 4996us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:49:08.606779 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:08.606789 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.608032 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.608033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:08.609366 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:08.609370 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.609934 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.609935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:08.610093 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:08.610758 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:49:08.610770 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:49:08.612544 (+ 1774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:49:08.614615 (+ 2071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:08.614622 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:08.614625 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:08.614916 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:08.615147 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:08.615147 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:08.615147 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:08.615271 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:08.615581 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:49:08.615588 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:49:08.615774 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 16:49:08.616755 (+ 981us) client_negotiation.cc:240] Negotiation successful
0811 16:49:08.616958 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":118,"threads_started":1}
I20260811 16:49:08.617931 20209 heartbeater.cc:347] Connected to a master server at 127.2.55.190:41029
I20260811 16:49:08.618047 20209 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:08.618247 20209 heartbeater.cc:511] Master 127.2.55.190:41029 requested a full tablet report, sending...
I20260811 16:49:08.618680 19656 ts_manager.cc:194] Registered new tserver with Master: 65fc31ecf3864fe5ba9e3d223e31d469 (127.2.55.130:37559)
I20260811 16:49:08.619161 19656 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:36717
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:49:08.652747 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.55.148:59063/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41029
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:36469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:49:08.785648 20214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:49:08.786046 20214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:49:08.786137 20214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:49:08.787988 20214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:49:08.788130 20214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:49:08.788226 20214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:49:08.790616 20214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:36469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.2.55.148:59063/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:49:08.791143 20214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:49:08.791517 20214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:49:08.798342 20223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:08.798465 20227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:08.798362 20222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:08.799604 20214 server_base.cc:1034] running on GCE node
I20260811 16:49:08.799850 20214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:49:08.800163 20214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:49:08.801363 20214 hybrid_clock.cc:648] HybridClock initialized: now 1786466948801344 us; error 35 us; skew 500 ppm
Aug 11 16:49:08 dist-test-slave-3h5h krb5kdc[18931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466948, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:49:08.804939 20214 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:49:08.805498 20214 webserver.cc:460] Webserver started at http://127.2.55.131:42657/ using document root <none> and password file <none>
I20260811 16:49:08.805827 20214 fs_manager.cc:359] Metadata directory not provided
I20260811 16:49:08.805923 20214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:49:08.806085 20214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:49:08 dist-test-slave-3h5h krb5kdc[18931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466948, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
I20260811 16:49:08.820084 20214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "873aa249f4604cdc8b0be85d99dc77fb"
format_stamp: "Formatted at 2026-08-11 16:49:08 on dist-test-slave-3h5h"
server_key: "30181717f70acf42ab791b1eda7a07f6"
server_key_iv: "f7fe9d57df1212f71b05002c4965779f"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:08.820791 20214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "873aa249f4604cdc8b0be85d99dc77fb"
format_stamp: "Formatted at 2026-08-11 16:49:08 on dist-test-slave-3h5h"
server_key: "30181717f70acf42ab791b1eda7a07f6"
server_key_iv: "f7fe9d57df1212f71b05002c4965779f"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:08.829293 20214 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.002s sys 0.000s
I20260811 16:49:08.850567 20241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:08.851750 20214 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 16:49:08.851915 20214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "873aa249f4604cdc8b0be85d99dc77fb"
format_stamp: "Formatted at 2026-08-11 16:49:08 on dist-test-slave-3h5h"
server_key: "30181717f70acf42ab791b1eda7a07f6"
server_key_iv: "f7fe9d57df1212f71b05002c4965779f"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:08.852075 20214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:49:08.878947 20214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:49:08.881364 20214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:49:08.881564 20214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:49:08.881855 20214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:49:08.882302 20214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:49:08.882391 20214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:08.882462 20214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:49:08.882521 20214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:08.893580 20214 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:43527
I20260811 16:49:08.894222 20214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:49:08.898202 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 20214
I20260811 16:49:08.898321 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:49:08.898600 2270 external_mini_cluster.cc:1428] Setting key 1a323d3ddd20e56881533134f0502ddc
I20260811 16:49:08.901549 20423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:43527 every 8 connection(s)
Aug 11 16:49:08 dist-test-slave-3h5h krb5kdc[18931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466948, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:49:08.906085 19989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:08.895291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:41893 (local address 127.2.55.190:41029)
0811 16:49:08.895342 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:08.895344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:08.895584 (+ 240us) server_negotiation.cc:407] Connection header received
0811 16:49:08.896134 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:08.896135 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:08.896149 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:08.896209 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:49:08.896823 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.897366 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.899813 (+ 2447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.900033 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.900117 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:08.902675 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:49:08.902678 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:49:08.902678 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:49:08.902687 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:49:08.904418 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:08.904980 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:08.904982 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:08.904982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:08.905054 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:08.905380 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:08.905382 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:08.905382 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:08.905515 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:49:08.905596 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:08.905892 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 16:49:08.905982 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:49:08.906292 20426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:08.895251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:41029 (local address 127.2.55.131:41893)
0811 16:49:08.895431 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:08.895477 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:08.896021 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:08.896287 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:08.896292 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:08.896508 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:49:08.896708 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:08.896713 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.897470 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.897471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:08.899722 (+ 2251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:08.899726 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.900126 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.900127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:08.900281 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:08.900905 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:49:08.900916 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:49:08.902570 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:49:08.904541 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:08.904549 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:08.904551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:08.904882 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:08.905135 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:08.905136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:08.905136 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:08.905279 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:08.905586 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:49:08.905594 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:49:08.905748 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 16:49:08.905869 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 16:49:08.906032 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":100,"threads_started":1}
I20260811 16:49:08.906880 20424 heartbeater.cc:347] Connected to a master server at 127.2.55.190:41029
I20260811 16:49:08.907009 20424 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:08.907212 20424 heartbeater.cc:511] Master 127.2.55.190:41029 requested a full tablet report, sending...
I20260811 16:49:08.907642 19656 ts_manager.cc:194] Registered new tserver with Master: 873aa249f4604cdc8b0be85d99dc77fb (127.2.55.131:43527)
I20260811 16:49:08.908073 19656 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:41893
I20260811 16:49:08.910526 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:49:08.924734 19989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:08.917287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48462 (local address 127.2.55.190:41029)
0811 16:49:08.917351 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:08.917353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:08.917659 (+ 306us) server_negotiation.cc:407] Connection header received
0811 16:49:08.917738 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:08.917739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:08.917751 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:08.917826 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:49:08.918488 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.919026 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.919794 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.920009 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.920088 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:08.921486 (+ 1398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:49:08.921488 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:49:08.921489 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:49:08.921509 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:49:08.923301 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:08.923745 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:08.923747 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:08.923747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:08.923813 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:08.924043 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:08.924044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:08.924044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:08.924186 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:49:08.924262 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:08.924563 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 16:49:08.924655 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:49:08.927667 19656 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48462:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:49:08.929517 19656 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:49:08.937397 20446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:08.932684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43558 (local address 127.2.55.129:33801)
0811 16:49:08.933525 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:08.933528 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:08.933537 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:49:08.933565 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:08.933567 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:08.933583 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:08.933674 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:49:08.933866 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.934687 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.936094 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.936746 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.936832 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:08.936928 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:08.937107 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 16:49:08.937307 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":812,"thread_start_us":128,"threads_started":1}
I20260811 16:49:08.937249 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:08.932208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:33801 (local address 127.0.0.1:43558)
0811 16:49:08.933408 (+ 1200us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:08.933414 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:08.933442 (+ 28us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:08.933694 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:08.933710 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:08.933712 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:49:08.933781 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:08.933783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.934772 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.934773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:08.936000 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:08.936002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.936899 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.936899 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:08.936992 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:08.937004 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 16:49:08.937090 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 16:49:08.937147 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1189,"mutex_wait_us":2,"thread_start_us":109,"threads_started":1}
I20260811 16:49:08.938403 19880 tablet_service.cc:1467] Processing CreateTablet for tablet e44f2dd9cc9c49db8ed6bfec8d91e162 (DEFAULT_TABLE table=test-table [id=0a9210ec7e8a4a43afe7c839f3913b45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:49:08.938818 19880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e44f2dd9cc9c49db8ed6bfec8d91e162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:49:08.942790 20447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:08.932704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46508 (local address 127.2.55.131:43527)
0811 16:49:08.933126 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:08.933133 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:08.938035 (+ 4902us) server_negotiation.cc:407] Connection header received
0811 16:49:08.938175 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:08.938178 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:08.938195 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:08.938251 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:49:08.938470 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.939514 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.941175 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.942107 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.942159 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:08.942232 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:08.942449 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 16:49:08.942489 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":106,"threads_started":1}
I20260811 16:49:08.943220 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:08.932487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:43527 (local address 127.0.0.1:46508)
0811 16:49:08.937958 (+ 5471us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:08.937969 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:08.938075 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:08.938359 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:08.938360 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:08.938362 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:49:08.938390 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:08.938391 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.939616 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.939617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:08.941035 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:08.941039 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.942295 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.942296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:08.942354 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:08.942357 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:49:08.943111 (+ 754us) client_negotiation.cc:240] Negotiation successful
0811 16:49:08.943150 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5458,"thread_start_us":71,"threads_started":1}
I20260811 16:49:08.944269 20321 tablet_service.cc:1467] Processing CreateTablet for tablet e44f2dd9cc9c49db8ed6bfec8d91e162 (DEFAULT_TABLE table=test-table [id=0a9210ec7e8a4a43afe7c839f3913b45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:49:08.944604 20321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e44f2dd9cc9c49db8ed6bfec8d91e162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:49:08.945186 20442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:08.932208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:37559 (local address 127.0.0.1:49164)
0811 16:49:08.933232 (+ 1024us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:08.933275 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:08.933330 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:08.941318 (+ 7988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:08.941319 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:08.941322 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:49:08.941384 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:08.941386 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.942862 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.942863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:08.943950 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:08.943953 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.944976 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.944978 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:08.945043 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:08.945048 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:49:08.945081 (+ 33us) client_negotiation.cc:240] Negotiation successful
0811 16:49:08.945118 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":966,"thread_start_us":181,"threads_started":1}
I20260811 16:49:08.945598 20445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:08.932556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49164 (local address 127.2.55.130:37559)
0811 16:49:08.941051 (+ 8495us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:08.941058 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:08.941076 (+ 18us) server_negotiation.cc:407] Connection header received
0811 16:49:08.941137 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:08.941139 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:08.941160 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:08.941482 (+ 322us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:49:08.941576 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.942747 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.944064 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:08.944803 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:08.945354 (+ 551us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:08.945442 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:08.945469 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 16:49:08.945518 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8435,"thread_start_us":116,"threads_started":1}
I20260811 16:49:08.947367 20453 tablet_bootstrap.cc:492] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb: Bootstrap starting.
I20260811 16:49:08.948259 20449 tablet_bootstrap.cc:492] T e44f2dd9cc9c49db8ed6bfec8d91e162 P acf7b2e42100479c81d9ce1f8767c556: Bootstrap starting.
I20260811 16:49:08.948176 20073 tablet_service.cc:1467] Processing CreateTablet for tablet e44f2dd9cc9c49db8ed6bfec8d91e162 (DEFAULT_TABLE table=test-table [id=0a9210ec7e8a4a43afe7c839f3913b45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:49:08.948551 20453 tablet_bootstrap.cc:654] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb: Neither blocks nor log segments found. Creating new log.
I20260811 16:49:08.948606 20073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e44f2dd9cc9c49db8ed6bfec8d91e162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:49:08.948971 20453 log.cc:824] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb: Log is configured to *not* fsync() on all Append() calls
I20260811 16:49:08.949240 20449 tablet_bootstrap.cc:654] T e44f2dd9cc9c49db8ed6bfec8d91e162 P acf7b2e42100479c81d9ce1f8767c556: Neither blocks nor log segments found. Creating new log.
I20260811 16:49:08.949661 20449 log.cc:824] T e44f2dd9cc9c49db8ed6bfec8d91e162 P acf7b2e42100479c81d9ce1f8767c556: Log is configured to *not* fsync() on all Append() calls
I20260811 16:49:08.950639 20449 tablet_bootstrap.cc:492] T e44f2dd9cc9c49db8ed6bfec8d91e162 P acf7b2e42100479c81d9ce1f8767c556: No bootstrap required, opened a new log
I20260811 16:49:08.950722 20449 ts_tablet_manager.cc:1397] T e44f2dd9cc9c49db8ed6bfec8d91e162 P acf7b2e42100479c81d9ce1f8767c556: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:49:08.953997 20449 raft_consensus.cc:348] T e44f2dd9cc9c49db8ed6bfec8d91e162 P acf7b2e42100479c81d9ce1f8767c556 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65fc31ecf3864fe5ba9e3d223e31d469" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 37559 } } peers { permanent_uuid: "acf7b2e42100479c81d9ce1f8767c556" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 33801 } } peers { permanent_uuid: "873aa249f4604cdc8b0be85d99dc77fb" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43527 } }
I20260811 16:49:08.954197 20449 raft_consensus.cc:374] T e44f2dd9cc9c49db8ed6bfec8d91e162 P acf7b2e42100479c81d9ce1f8767c556 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:49:08.954241 20449 raft_consensus.cc:729] T e44f2dd9cc9c49db8ed6bfec8d91e162 P acf7b2e42100479c81d9ce1f8767c556 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acf7b2e42100479c81d9ce1f8767c556, State: Initialized, Role: FOLLOWER
I20260811 16:49:08.954591 20449 consensus_queue.cc:260] T e44f2dd9cc9c49db8ed6bfec8d91e162 P acf7b2e42100479c81d9ce1f8767c556 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65fc31ecf3864fe5ba9e3d223e31d469" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 37559 } } peers { permanent_uuid: "acf7b2e42100479c81d9ce1f8767c556" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 33801 } } peers { permanent_uuid: "873aa249f4604cdc8b0be85d99dc77fb" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43527 } }
I20260811 16:49:08.955039 20449 ts_tablet_manager.cc:1428] T e44f2dd9cc9c49db8ed6bfec8d91e162 P acf7b2e42100479c81d9ce1f8767c556: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 16:49:08.955250 19984 heartbeater.cc:503] Master 127.2.55.190:41029 was elected leader, sending a full tablet report...
I20260811 16:49:08.956691 20457 tablet_bootstrap.cc:492] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469: Bootstrap starting.
I20260811 16:49:08.957836 20457 tablet_bootstrap.cc:654] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469: Neither blocks nor log segments found. Creating new log.
I20260811 16:49:08.958179 20457 log.cc:824] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469: Log is configured to *not* fsync() on all Append() calls
I20260811 16:49:08.959080 20457 tablet_bootstrap.cc:492] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469: No bootstrap required, opened a new log
I20260811 16:49:08.959177 20457 ts_tablet_manager.cc:1397] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:49:08.961272 20453 tablet_bootstrap.cc:492] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb: No bootstrap required, opened a new log
I20260811 16:49:08.961380 20453 ts_tablet_manager.cc:1397] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.002s
I20260811 16:49:08.963559 20453 raft_consensus.cc:348] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65fc31ecf3864fe5ba9e3d223e31d469" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 37559 } } peers { permanent_uuid: "acf7b2e42100479c81d9ce1f8767c556" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 33801 } } peers { permanent_uuid: "873aa249f4604cdc8b0be85d99dc77fb" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43527 } }
I20260811 16:49:08.963840 20453 raft_consensus.cc:374] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:49:08.963943 20453 raft_consensus.cc:729] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873aa249f4604cdc8b0be85d99dc77fb, State: Initialized, Role: FOLLOWER
I20260811 16:49:08.964177 20453 consensus_queue.cc:260] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65fc31ecf3864fe5ba9e3d223e31d469" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 37559 } } peers { permanent_uuid: "acf7b2e42100479c81d9ce1f8767c556" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 33801 } } peers { permanent_uuid: "873aa249f4604cdc8b0be85d99dc77fb" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43527 } }
I20260811 16:49:08.964607 20453 ts_tablet_manager.cc:1428] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 16:49:08.964808 20424 heartbeater.cc:503] Master 127.2.55.190:41029 was elected leader, sending a full tablet report...
I20260811 16:49:08.966187 20457 raft_consensus.cc:348] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65fc31ecf3864fe5ba9e3d223e31d469" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 37559 } } peers { permanent_uuid: "acf7b2e42100479c81d9ce1f8767c556" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 33801 } } peers { permanent_uuid: "873aa249f4604cdc8b0be85d99dc77fb" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43527 } }
I20260811 16:49:08.966420 20457 raft_consensus.cc:374] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:49:08.966497 20457 raft_consensus.cc:729] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65fc31ecf3864fe5ba9e3d223e31d469, State: Initialized, Role: FOLLOWER
I20260811 16:49:08.966694 20457 consensus_queue.cc:260] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65fc31ecf3864fe5ba9e3d223e31d469" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 37559 } } peers { permanent_uuid: "acf7b2e42100479c81d9ce1f8767c556" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 33801 } } peers { permanent_uuid: "873aa249f4604cdc8b0be85d99dc77fb" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43527 } }
I20260811 16:49:08.967029 20457 ts_tablet_manager.cc:1428] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260811 16:49:08.967062 20209 heartbeater.cc:503] Master 127.2.55.190:41029 was elected leader, sending a full tablet report...
W20260811 16:49:09.009711 19985 tablet.cc:2369] T e44f2dd9cc9c49db8ed6bfec8d91e162 P acf7b2e42100479c81d9ce1f8767c556: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 16:49:09 dist-test-slave-3h5h krb5kdc[18931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466948, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
W20260811 16:49:09.098590 20210 tablet.cc:2369] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:49:09.152189 20425 tablet.cc:2369] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:49:09.173483 20462 raft_consensus.cc:482] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:49:09.173666 20462 raft_consensus.cc:504] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65fc31ecf3864fe5ba9e3d223e31d469" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 37559 } } peers { permanent_uuid: "acf7b2e42100479c81d9ce1f8767c556" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 33801 } } peers { permanent_uuid: "873aa249f4604cdc8b0be85d99dc77fb" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43527 } }
I20260811 16:49:09.174207 20462 leader_election.cc:288] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acf7b2e42100479c81d9ce1f8767c556 (127.2.55.129:33801), 873aa249f4604cdc8b0be85d99dc77fb (127.2.55.131:43527)
I20260811 16:49:09.178570 20447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:09.174854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:60621 (local address 127.2.55.131:43527)
0811 16:49:09.174939 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:09.174941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:09.174993 (+ 52us) server_negotiation.cc:407] Connection header received
0811 16:49:09.175116 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:09.175117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:09.175127 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:09.175159 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:49:09.175406 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:09.176129 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:09.177593 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:09.178149 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:09.178209 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:09.178219 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:09.178449 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 16:49:09.178494 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 16:49:09.178858 20466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:09.174680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:43527 (local address 127.2.55.130:60621)
0811 16:49:09.174916 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:09.174928 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:09.175024 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:09.175238 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:09.175239 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:09.175240 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:49:09.175322 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:09.175324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:09.176260 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:09.176261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:09.177481 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:09.177484 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:09.178284 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:09.178285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:09.178363 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:09.178367 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:49:09.178715 (+ 348us) client_negotiation.cc:240] Negotiation successful
0811 16:49:09.178767 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":2,"thread_start_us":61,"threads_started":1}
I20260811 16:49:09.178570 20446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:09.174550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:45101 (local address 127.2.55.129:33801)
0811 16:49:09.174606 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:09.174609 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:09.174719 (+ 110us) server_negotiation.cc:407] Connection header received
0811 16:49:09.174828 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:09.174830 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:09.174839 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:09.174870 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:49:09.175177 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:09.175919 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:09.177548 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:09.178149 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:09.178204 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:09.178214 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:09.178431 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 16:49:09.178477 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:49:09.179227 20360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e44f2dd9cc9c49db8ed6bfec8d91e162" candidate_uuid: "65fc31ecf3864fe5ba9e3d223e31d469" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873aa249f4604cdc8b0be85d99dc77fb" is_pre_election: true
I20260811 16:49:09.179330 20465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:09.174451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:33801 (local address 127.2.55.130:45101)
0811 16:49:09.174630 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:09.174642 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:09.174747 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:09.174998 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:09.174999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:09.175002 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:49:09.175079 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:09.175082 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:09.176032 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:09.176033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:09.177393 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:09.177396 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:09.178278 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:09.178278 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:09.178351 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:09.178355 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:49:09.179205 (+ 850us) client_negotiation.cc:240] Negotiation successful
0811 16:49:09.179261 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":51,"thread_start_us":95,"threads_started":1}
I20260811 16:49:09.179416 20360 raft_consensus.cc:2454] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65fc31ecf3864fe5ba9e3d223e31d469 in term 0.
I20260811 16:49:09.179662 20027 leader_election.cc:302] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65fc31ecf3864fe5ba9e3d223e31d469, 873aa249f4604cdc8b0be85d99dc77fb; no voters:
I20260811 16:49:09.179766 19888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e44f2dd9cc9c49db8ed6bfec8d91e162" candidate_uuid: "65fc31ecf3864fe5ba9e3d223e31d469" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acf7b2e42100479c81d9ce1f8767c556" is_pre_election: true
I20260811 16:49:09.179862 20462 raft_consensus.cc:2781] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:49:09.179912 20462 raft_consensus.cc:482] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:49:09.179934 20462 raft_consensus.cc:3037] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:49:09.179929 19888 raft_consensus.cc:2454] T e44f2dd9cc9c49db8ed6bfec8d91e162 P acf7b2e42100479c81d9ce1f8767c556 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65fc31ecf3864fe5ba9e3d223e31d469 in term 0.
I20260811 16:49:09.180958 20462 raft_consensus.cc:504] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65fc31ecf3864fe5ba9e3d223e31d469" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 37559 } } peers { permanent_uuid: "acf7b2e42100479c81d9ce1f8767c556" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 33801 } } peers { permanent_uuid: "873aa249f4604cdc8b0be85d99dc77fb" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43527 } }
I20260811 16:49:09.181128 20462 leader_election.cc:288] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [CANDIDATE]: Term 1 election: Requested vote from peers acf7b2e42100479c81d9ce1f8767c556 (127.2.55.129:33801), 873aa249f4604cdc8b0be85d99dc77fb (127.2.55.131:43527)
I20260811 16:49:09.181358 20360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e44f2dd9cc9c49db8ed6bfec8d91e162" candidate_uuid: "65fc31ecf3864fe5ba9e3d223e31d469" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873aa249f4604cdc8b0be85d99dc77fb"
I20260811 16:49:09.181370 19888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e44f2dd9cc9c49db8ed6bfec8d91e162" candidate_uuid: "65fc31ecf3864fe5ba9e3d223e31d469" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acf7b2e42100479c81d9ce1f8767c556"
I20260811 16:49:09.181449 19888 raft_consensus.cc:3037] T e44f2dd9cc9c49db8ed6bfec8d91e162 P acf7b2e42100479c81d9ce1f8767c556 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:49:09.181449 20360 raft_consensus.cc:3037] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:49:09.182408 20360 raft_consensus.cc:2454] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65fc31ecf3864fe5ba9e3d223e31d469 in term 1.
I20260811 16:49:09.182529 19888 raft_consensus.cc:2454] T e44f2dd9cc9c49db8ed6bfec8d91e162 P acf7b2e42100479c81d9ce1f8767c556 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65fc31ecf3864fe5ba9e3d223e31d469 in term 1.
I20260811 16:49:09.182654 20027 leader_election.cc:302] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65fc31ecf3864fe5ba9e3d223e31d469, 873aa249f4604cdc8b0be85d99dc77fb; no voters:
I20260811 16:49:09.182788 20462 raft_consensus.cc:2781] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:49:09.182994 20462 raft_consensus.cc:686] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [term 1 LEADER]: Becoming Leader. State: Replica: 65fc31ecf3864fe5ba9e3d223e31d469, State: Running, Role: LEADER
I20260811 16:49:09.183125 20462 consensus_queue.cc:237] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65fc31ecf3864fe5ba9e3d223e31d469" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 37559 } } peers { permanent_uuid: "acf7b2e42100479c81d9ce1f8767c556" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 33801 } } peers { permanent_uuid: "873aa249f4604cdc8b0be85d99dc77fb" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43527 } }
I20260811 16:49:09.184122 19656 catalog_manager.cc:5495] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65fc31ecf3864fe5ba9e3d223e31d469 (127.2.55.130). New cstate: current_term: 1 leader_uuid: "65fc31ecf3864fe5ba9e3d223e31d469" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65fc31ecf3864fe5ba9e3d223e31d469" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 37559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acf7b2e42100479c81d9ce1f8767c556" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 33801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873aa249f4604cdc8b0be85d99dc77fb" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43527 } health_report { overall_health: UNKNOWN } } }
I20260811 16:49:09.220081 20445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:09.216555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49176 (local address 127.2.55.130:37559)
0811 16:49:09.216614 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:09.216617 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:09.216643 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:49:09.216696 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:09.216697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:09.216716 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:09.216799 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:49:09.216994 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:09.217735 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:09.218929 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:09.219246 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:09.219328 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:09.219588 (+ 260us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:49:09.219735 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:49:09.219825 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:09.219950 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 16:49:09.219976 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 16:49:09.222368 20360 raft_consensus.cc:1261] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb [term 1 FOLLOWER]: Refusing update from remote peer 65fc31ecf3864fe5ba9e3d223e31d469: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:49:09.222415 19888 raft_consensus.cc:1261] T e44f2dd9cc9c49db8ed6bfec8d91e162 P acf7b2e42100479c81d9ce1f8767c556 [term 1 FOLLOWER]: Refusing update from remote peer 65fc31ecf3864fe5ba9e3d223e31d469: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:49:09.222728 20462 consensus_queue.cc:1035] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873aa249f4604cdc8b0be85d99dc77fb" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 43527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:49:09.222893 20462 consensus_queue.cc:1035] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acf7b2e42100479c81d9ce1f8767c556" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 33801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:49:09.227535 20478 mvcc.cc:205] Tried to move back new op lower bound from 7317368624011821056 to 7317368623854825472. Current Snapshot: MvccSnapshot[applied={T|T < 7317368624011821056}]
I20260811 16:49:09.227716 20480 mvcc.cc:205] Tried to move back new op lower bound from 7317368624011821056 to 7317368623854825472. Current Snapshot: MvccSnapshot[applied={T|T < 7317368624011821056}]
I20260811 16:49:09.230819 19655 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48462:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:49:09.230947 19655 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48462:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:49:09.231936 19655 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5a480d707d1b4ba9b7cfe3f395231678: Sending DeleteTablet for 3 replicas of tablet e44f2dd9cc9c49db8ed6bfec8d91e162
I20260811 16:49:09.232669 19880 tablet_service.cc:1514] Processing DeleteTablet for tablet e44f2dd9cc9c49db8ed6bfec8d91e162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:49:09 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:43558
I20260811 16:49:09.232687 20321 tablet_service.cc:1514] Processing DeleteTablet for tablet e44f2dd9cc9c49db8ed6bfec8d91e162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:49:09 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:46508
I20260811 16:49:09.232760 20073 tablet_service.cc:1514] Processing DeleteTablet for tablet e44f2dd9cc9c49db8ed6bfec8d91e162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:49:09 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:49164
I20260811 16:49:09.233554 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 19782
I20260811 16:49:09.264292 20490 tablet_replica.cc:330] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb: stopping tablet replica
I20260811 16:49:09.264492 20490 raft_consensus.cc:2229] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:49:09.264647 20490 raft_consensus.cc:2258] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:49:09.264916 20491 tablet_replica.cc:330] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469: stopping tablet replica
I20260811 16:49:09.265053 20491 raft_consensus.cc:2229] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:49:09.265206 20491 raft_consensus.cc:2258] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:49:09.265789 20490 ts_tablet_manager.cc:1905] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:49:09.265847 20491 ts_tablet_manager.cc:1905] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 65fc31ecf3864fe5ba9e3d223e31d469: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:49:09.273168 20490 ts_tablet_manager.cc:1918] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:49:09.273332 20490 log.cc:1196] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/e44f2dd9cc9c49db8ed6bfec8d91e162
I20260811 16:49:09.274065 20490 ts_tablet_manager.cc:1939] T e44f2dd9cc9c49db8ed6bfec8d91e162 P 873aa249f4604cdc8b0be85d99dc77fb: Deleting consensus metadata
I20260811 16:49:09.274660 19636 catalog_manager.cc:4841] TS 873aa249f4604cdc8b0be85d99dc77fb (127.2.55.131:43527): tablet e44f2dd9cc9c49db8ed6bfec8d91e162 (table test-table [id=0a9210ec7e8a4a43afe7c839f3913b45]) successfully deleted
W20260811 16:49:09.275429 19636 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.55.129:33801 (error 108)
I20260811 16:49:09.276472 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:09.276327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:33801 (local address 127.0.0.1:43566)
0811 16:49:09.276381 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:09.276428 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:33801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 16:49:09.276525 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 20000
W20260811 16:49:09.280606 19636 catalog_manager.cc:4584] TS acf7b2e42100479c81d9ce1f8767c556 (127.2.55.129:33801): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e44f2dd9cc9c49db8ed6bfec8d91e162: Network error: Client connection negotiation failed: client connection to 127.2.55.129:33801: connect: Connection refused (error 111)
I20260811 16:49:09.285998 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 20214
I20260811 16:49:09.290814 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:09.290653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:37559 (local address 127.0.0.1:49184)
0811 16:49:09.290718 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:09.290761 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.130:37559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 16:49:09.294930 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 19609
I20260811 16:49:09.316393 2270 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 16:49:09.672921 2270 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 16:49:09.673111 2270 mini_ranger.cc:66] Stopping Ranger...
I20260811 16:49:10.028304 2270 mini_ranger.cc:68] Stopped Ranger
2026-08-11 16:49:10.028 UTC [18986] LOG: received smart shutdown request
2026-08-11 16:49:10.033 UTC [18986] LOG: background worker "logical replication launcher" (PID 18997) exited with exit code 1
2026-08-11 16:49:10.033 UTC [18991] LOG: shutting down
2026-08-11 16:49:10.241 UTC [18986] LOG: database system is shut down
2026-08-11T16:49:10Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (52295 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:49:10 dist-test-slave-3h5h krb5kdc[20506](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:49:10 dist-test-slave-3h5h krb5kdc[20506](info): set up 2 sockets
Aug 11 16:49:10 dist-test-slave-3h5h krb5kdc[20506](info): commencing operation
krb5kdc: starting...
W20260811 16:49:11.708441 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.305s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:49:11 dist-test-slave-3h5h krb5kdc[20506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466951, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:49:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:49:11Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.2.55.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.2.55.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.2.55.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/rangeradmin_127.2.55.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.2.55.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/rangeradmin_127.2.55.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.2.55.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.2.55.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.2.55.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/rangerlookup_127.2.55.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.2.55.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/rangerlookup_127.2.55.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.2.55.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.2.55.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.2.55.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/HTTP_127.2.55.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.2.55.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/HTTP_127.2.55.148@KRBTEST.COM.keytab.
I20260811 16:49:11.900302 2270 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskCmcTbT/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/postgres -l logfile start
2026-08-11 16:49:14.668 UTC [20552] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 16:49:14.669 UTC [20552] LOG: listening on IPv4 address "127.2.55.148", port 53309
2026-08-11 16:49:14.673 UTC [20552] LOG: listening on Unix socket "/tmp/.s.PGSQL.53309"
2026-08-11 16:49:14.710 UTC [20559] LOG: database system was shut down at 2026-08-11 16:49:13 UTC
2026-08-11 16:49:14.714 UTC [20552] LOG: database system is ready to accept connections
I20260811 16:49:15.859298 2270 mini_postgres.cc:96] Postgres bound to 53309
2026-08-11 16:49:15.866 UTC [20571] FATAL: database "slave" does not exist
127.2.55.148:53309 - accepting connections
I20260811 16:49:15.867345 2270 mini_ranger.cc:161] Starting Ranger...
I20260811 16:49:15.884325 2270 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 16:49:16.429215 2270 mini_ranger.cc:87] Created ranger Postgres database
I20260811 16:49:16.429309 2270 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-admin
2026-08-11 16:49:16,721 [I] DB FLAVOR :POSTGRES
2026-08-11 16:49:16,721 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 16:49:16,721 [I] Checking connection..
2026-08-11 16:49:16,721 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 16:49:17,001 [I] Checking connection passed.
2026-08-11 16:49:17,001 [I] --------- Verifying version history table ---------
2026-08-11 16:49:17,001 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:49:17,280 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 16:49:17,281 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:49:17,557 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 16:49:17,557 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 16:49:17,557 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 16:49:17.836 UTC [20679] WARNING: there is no transaction in progress
2026-08-11 16:49:17,847 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 16:49:17,847 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:49:18,125 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 16:49:18,125 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 16:49:18,125 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 16:49:18,368 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 16:49:18,629 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-3h5h.c.gcp-upstream.internal','N') ;"
2026-08-11 16:49:18,913 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 16:49:19,182 [I] Table x_portal_user does not exist in database ranger
2026-08-11 16:49:19,182 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 16:49:19,476 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 16:49:19,476 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 16:49:19,711 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 16:49:19,971 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 16:49:19,971 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 16:49:20.995 UTC [20854] WARNING: there is no transaction in progress
2026-08-11 16:49:21.014 UTC [20854] WARNING: there is no transaction in progress
2026-08-11 16:49:21.033 UTC [20854] WARNING: there is no transaction in progress
2026-08-11 16:49:21.051 UTC [20854] WARNING: there is no transaction in progress
2026-08-11 16:49:21.070 UTC [20854] WARNING: there is no transaction in progress
2026-08-11 16:49:21.091 UTC [20854] WARNING: there is no transaction in progress
2026-08-11 16:49:21.153 UTC [20854] WARNING: there is no transaction in progress
2026-08-11 16:49:21.161 UTC [20854] WARNING: there is no transaction in progress
2026-08-11 16:49:21.178 UTC [20854] WARNING: there is no transaction in progress
2026-08-11 16:49:21.189 UTC [20854] WARNING: there is no transaction in progress
2026-08-11 16:49:21.200 UTC [20854] WARNING: there is no transaction in progress
2026-08-11 16:49:21.216 UTC [20854] WARNING: there is no transaction in progress
2026-08-11 16:49:21.227 UTC [20854] WARNING: there is no transaction in progress
2026-08-11 16:49:21.234 UTC [20854] WARNING: there is no transaction in progress
2026-08-11 16:49:21.241 UTC [20854] WARNING: there is no transaction in progress
2026-08-11 16:49:21.249 UTC [20854] WARNING: there is no transaction in progress
2026-08-11 16:49:21,942 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 16:49:21,943 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 16:49:22,193 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 16:49:22,193 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 16:49:22,448 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 16:49:22,448 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 16:49:22,698 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 16:49:22,698 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 16:49:22,980 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 16:49:23,242 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-3h5h.c.gcp-upstream.internal';"
2026-08-11 16:49:23,481 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 16:49:23,481 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 16:49:23,767 [I] DB_PATCHES have already been applied
I20260811 16:49:23.773749 2270 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-admin:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskCmcTbT/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 16:49:23.773825 2270 mini_ranger.cc:193] Using host: 127.2.55.148
I20260811 16:49:23.777942 2270 mini_ranger.cc:227] Ranger admin URL: http://127.2.55.148:40123
Aug 11, 2026 4:49:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 4:49:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 4:49:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 4:49:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 4:49:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 4:49:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 4:49:24 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 16:49:25.254702 2270 mini_ranger.cc:160] Time spent starting Ranger: real 9.387s user 0.001s sys 0.011s
Aug 11, 2026 4:49:45 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 4:49:45 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 4:49:45 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 4:49:45 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 4:49:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 4:49:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 4:49:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 4:49:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 4:49:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 4:49:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 4:49:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 4:49:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 4:49:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 4:49:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 4:49:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 4:49:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 4:49:45 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 4:49:46 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 16:49:46.967175 2270 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.2.55.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.2.55.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.2.55.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/rangerkms_127.2.55.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.2.55.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/rangerkms_127.2.55.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.2.55.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.2.55.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.2.55.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/HTTP_127.2.55.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.2.55.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/HTTP_127.2.55.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 16:49:47 dist-test-slave-3h5h krb5kdc[20506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466987, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 16:49:47.057775 2270 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 16:49:47.068595 2270 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 16:49:48.009516 2270 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 16:49:48.009615 2270 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-kms
I20260811 16:49:48.009640 2270 mini_ranger_kms.cc:227] Using postgres at 127.2.55.148:53309
2026-08-11 16:49:48,201 [I] DB FLAVOR :POSTGRES
2026-08-11 16:49:48,201 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 16:49:48,202 [I] Checking connection
2026-08-11 16:49:48,202 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 16:49:48,464 [I] connection success
2026-08-11 16:49:48,464 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 16:49:48,464 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 16:49:48,464 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 16:49:48,702 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 16:49:48,703 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 16:49:48,703 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 16:49:48,703 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.55.148:53309/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 16:49:48,972 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 16:49:49.423312 2270 mini_ranger_kms.cc:310] Created kms service
I20260811 16:49:49.635741 2270 mini_ranger_kms.cc:326] Created kudu user
I20260811 16:49:49.685174 2270 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 16:49:49 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466987, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
I20260811 16:49:50.095707 2270 mini_ranger_kms.cc:384] Added ranger policy
I20260811 16:49:50.095842 2270 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-kms:/tmp/dist-test-taskCmcTbT/build/release/bin/postgresql.jar:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskCmcTbT/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 16:49:50.095862 2270 mini_ranger_kms.cc:240] Using host: 127.2.55.148
I20260811 16:49:50.100785 2270 mini_ranger_kms.cc:276] Ranger KMS PID: 21170
I20260811 16:49:50.100911 2270 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.2.55.148:41101
Aug 11, 2026 4:49:51 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 4:49:51 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 4:49:51 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 4:49:51 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 4:49:51 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 4:49:51 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 16:49:52 dist-test-slave-3h5h krb5kdc[20506](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786466992, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.2.55.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:49:52.891142 2270 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.833s user 0.014s sys 0.161s
I20260811 16:49:52.891263 2270 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 16:49:52.891326 2270 mini_ranger_kms.cc:401] 127.2.55.148:41101/kms/v1/keys
Aug 11 16:49:53 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466992, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.2.55.148@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
Aug 11 16:49:53 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466992, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.2.55.148@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
Aug 11 16:49:56 dist-test-slave-3h5h krb5kdc[20506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:49:56.060982 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:41375
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:38655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:41375
--ranger_config_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.55.148:41101/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:49:56.152702 21250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:49:56.153004 21250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:49:56.153033 21250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:49:56.154234 21250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:49:56.154279 21250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:49:56.154294 21250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:49:56.154306 21250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:49:56.154320 21250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:49:56.156009 21250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:38655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/wal
--ranger_kms_url=127.2.55.148:41101/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:41375
--ranger_config_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:41375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:49:56.156260 21250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:49:56.156538 21250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:49:56.162349 21250 server_base.cc:1034] running on GCE node
W20260811 16:49:56.162314 21259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:56.162447 21261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:56.162683 21268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:56.162983 21250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:49:56.163365 21250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:49:56.164563 21250 hybrid_clock.cc:648] HybridClock initialized: now 1786466996164546 us; error 41 us; skew 500 ppm
Aug 11 16:49:56 dist-test-slave-3h5h krb5kdc[20506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466996, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:49:56.167757 21250 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:49:56.168255 21250 webserver.cc:460] Webserver started at http://127.2.55.190:38263/ using document root <none> and password file <none>
I20260811 16:49:56.168515 21250 fs_manager.cc:359] Metadata directory not provided
I20260811 16:49:56.168578 21250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:49:56.168743 21250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:49:56 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466996, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
I20260811 16:49:56.224727 21250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "57bc7db2d8c94b54a231c3896d981861"
format_stamp: "Formatted at 2026-08-11 16:49:56 on dist-test-slave-3h5h"
server_key: "40806c2b0cb74c921693ac576a3a0d92"
server_key_iv: "84334e3c6c5d7c2c1bf91e00dbc10eb4"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:56.225256 21250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "57bc7db2d8c94b54a231c3896d981861"
format_stamp: "Formatted at 2026-08-11 16:49:56 on dist-test-slave-3h5h"
server_key: "40806c2b0cb74c921693ac576a3a0d92"
server_key_iv: "84334e3c6c5d7c2c1bf91e00dbc10eb4"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:56.226727 21250 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:49:56.243057 21282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:56.243319 21250 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:49:56.243430 21250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "57bc7db2d8c94b54a231c3896d981861"
format_stamp: "Formatted at 2026-08-11 16:49:56 on dist-test-slave-3h5h"
server_key: "40806c2b0cb74c921693ac576a3a0d92"
server_key_iv: "84334e3c6c5d7c2c1bf91e00dbc10eb4"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:56.243533 21250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:49:56.263131 21250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:49:56.265336 21250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:49:56.265496 21250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:49:56.270781 21250 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:41375
I20260811 16:49:56.270859 21364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:41375 every 8 connection(s)
I20260811 16:49:56.271251 21250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:49:56.272006 21366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:49:56.274503 21366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861: Bootstrap starting.
I20260811 16:49:56.275125 21366 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861: Neither blocks nor log segments found. Creating new log.
I20260811 16:49:56.275434 21366 log.cc:824] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861: Log is configured to *not* fsync() on all Append() calls
I20260811 16:49:56.276161 21366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861: No bootstrap required, opened a new log
I20260811 16:49:56.278328 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 21250
I20260811 16:49:56.278448 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:49:56.278326 21366 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57bc7db2d8c94b54a231c3896d981861" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41375 } }
I20260811 16:49:56.278570 21366 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:49:56.278647 2270 external_mini_cluster.cc:1428] Setting key 6aaa4601269d66b83cb9867d401027b8
I20260811 16:49:56.278658 21366 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57bc7db2d8c94b54a231c3896d981861, State: Initialized, Role: FOLLOWER
I20260811 16:49:56.278867 21366 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57bc7db2d8c94b54a231c3896d981861" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41375 } }
I20260811 16:49:56.278966 21366 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:49:56.279006 21366 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:49:56.279089 21366 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:49:56.279942 21366 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57bc7db2d8c94b54a231c3896d981861" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41375 } }
I20260811 16:49:56.280066 21366 leader_election.cc:302] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57bc7db2d8c94b54a231c3896d981861; no voters:
I20260811 16:49:56.280247 21366 leader_election.cc:288] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:49:56.280300 21376 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:49:56.280529 21376 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 1 LEADER]: Becoming Leader. State: Replica: 57bc7db2d8c94b54a231c3896d981861, State: Running, Role: LEADER
I20260811 16:49:56.280647 21366 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:49:56.280660 21376 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57bc7db2d8c94b54a231c3896d981861" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41375 } }
I20260811 16:49:56.282712 21378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57bc7db2d8c94b54a231c3896d981861" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57bc7db2d8c94b54a231c3896d981861" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41375 } } }
I20260811 16:49:56.282814 21378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [sys.catalog]: This master's current role is: LEADER
I20260811 16:49:56.282938 21395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57bc7db2d8c94b54a231c3896d981861. Latest consensus state: current_term: 1 leader_uuid: "57bc7db2d8c94b54a231c3896d981861" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57bc7db2d8c94b54a231c3896d981861" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41375 } } }
I20260811 16:49:56.283023 21395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [sys.catalog]: This master's current role is: LEADER
I20260811 16:49:56.283591 21396 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:49:56.283708 21366 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 16:49:56.284315 21396 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 16:49:56 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:49:56.288219 21396 catalog_manager.cc:1347] Generated new cluster ID: b4221da811d645afa13f39f631b6c907
I20260811 16:49:56.288348 21396 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:49:56.293586 21375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:56.279250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58190 (local address 127.2.55.190:41375)
0811 16:49:56.279460 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:56.279470 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:56.279504 (+ 34us) server_negotiation.cc:407] Connection header received
0811 16:49:56.279630 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:56.279638 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:56.279696 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:56.279852 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:49:56.280750 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:56.282264 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:56.283503 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:56.284150 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:56.284268 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:56.289013 (+ 4745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:49:56.289080 (+ 67us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:49:56.289080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:49:56.289159 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:49:56.291561 (+ 2402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:56.292003 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:56.292007 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:56.292007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:56.292125 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:56.292371 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:56.292372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:56.292373 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:56.292717 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:49:56.292890 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:56.293167 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 16:49:56.293350 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":81,"threads_started":1}
I20260811 16:49:56.300149 21396 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:49:56.300981 21396 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:49:56.308704 21396 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861: Generated new TSK 0
I20260811 16:49:56.309031 21396 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:49:57.114444 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.55.148:41101/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41375
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:38655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:49:57.251113 21451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:49:57.251524 21451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:49:57.251614 21451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:49:57.253717 21451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:49:57.253872 21451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:49:57.253970 21451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:49:57.256626 21451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:38655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.2.55.148:41101/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41375
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:49:57.256963 21451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:49:57.257270 21451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:49:57.264670 21462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:57.264951 21451 server_base.cc:1034] running on GCE node
W20260811 16:49:57.265172 21458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:57.264671 21460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:57.265686 21451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:49:57.266022 21451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:49:57.267205 21451 hybrid_clock.cc:648] HybridClock initialized: now 1786466997267170 us; error 50 us; skew 500 ppm
Aug 11 16:49:57 dist-test-slave-3h5h krb5kdc[20506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466997, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:49:57.271277 21451 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:49:57.272030 21451 webserver.cc:460] Webserver started at http://127.2.55.129:46785/ using document root <none> and password file <none>
I20260811 16:49:57.272481 21451 fs_manager.cc:359] Metadata directory not provided
I20260811 16:49:57.272626 21451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:49:57.272868 21451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:49:57 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466997, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
I20260811 16:49:57.289505 21451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "2be13503ec6c4cdabaa5dab22427e942"
format_stamp: "Formatted at 2026-08-11 16:49:57 on dist-test-slave-3h5h"
server_key: "0e085a1063d718a49c081d39406cc56a"
server_key_iv: "a98e85c6aa35858fcc184ce4fcfaaae5"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:57.290221 21451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "2be13503ec6c4cdabaa5dab22427e942"
format_stamp: "Formatted at 2026-08-11 16:49:57 on dist-test-slave-3h5h"
server_key: "0e085a1063d718a49c081d39406cc56a"
server_key_iv: "a98e85c6aa35858fcc184ce4fcfaaae5"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:57.297181 21451 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.000s
I20260811 16:49:57.318439 21477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:57.318718 21451 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:49:57.318817 21451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "2be13503ec6c4cdabaa5dab22427e942"
format_stamp: "Formatted at 2026-08-11 16:49:57 on dist-test-slave-3h5h"
server_key: "0e085a1063d718a49c081d39406cc56a"
server_key_iv: "a98e85c6aa35858fcc184ce4fcfaaae5"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:57.318912 21451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:49:57.343636 21451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:49:57.346436 21451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:49:57.346614 21451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:49:57.346868 21451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:49:57.347383 21451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:49:57.347453 21451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:57.347506 21451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:49:57.347534 21451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:57.354696 21451 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:41701
I20260811 16:49:57.355181 21451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:49:57.356943 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 21451
I20260811 16:49:57.357085 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:49:57.357296 2270 external_mini_cluster.cc:1428] Setting key 2422703a49fd328eb62237136a46ef40
I20260811 16:49:57.362121 21661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:41701 every 8 connection(s)
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
Aug 11 16:49:57 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466997, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
I20260811 16:49:57.383170 21668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:57.362902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:41375 (local address 127.2.55.129:54241)
0811 16:49:57.364991 (+ 2089us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:57.365052 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:57.365915 (+ 863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:57.366441 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:57.366446 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:57.366687 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:49:57.366900 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:57.366905 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:57.368162 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:57.368163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:57.369754 (+ 1591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:57.369758 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:57.370410 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:57.370411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:57.370591 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:57.371285 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:49:57.371299 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:49:57.376365 (+ 5066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:49:57.381165 (+ 4800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:57.381177 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:57.381181 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:57.381561 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:57.381818 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:57.381819 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:57.381820 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:57.381983 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:57.382301 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:49:57.382309 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:49:57.382502 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 16:49:57.382626 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 16:49:57.382897 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2022,"thread_start_us":120,"threads_started":1}
I20260811 16:49:57.383571 21670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:57.363270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:54241 (local address 127.2.55.190:41375)
0811 16:49:57.366160 (+ 2890us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:57.366163 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:57.366172 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:49:57.366201 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:57.366202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:57.366218 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:57.366289 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:49:57.367030 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:57.368008 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:57.369874 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:57.370236 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:57.370313 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:57.376527 (+ 6214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:49:57.376529 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:49:57.376529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:49:57.376539 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:49:57.381039 (+ 4500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:57.381669 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:57.381671 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:57.381672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:57.381746 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:57.382060 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:57.382061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:57.382062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:57.382214 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:49:57.382274 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:57.383370 (+ 1096us) server_negotiation.cc:299] Negotiation successful
0811 16:49:57.383478 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2860,"thread_start_us":64,"threads_started":1}
I20260811 16:49:57.384058 21662 heartbeater.cc:347] Connected to a master server at 127.2.55.190:41375
I20260811 16:49:57.384193 21662 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:57.384442 21662 heartbeater.cc:511] Master 127.2.55.190:41375 requested a full tablet report, sending...
I20260811 16:49:57.385040 21310 ts_manager.cc:194] Registered new tserver with Master: 2be13503ec6c4cdabaa5dab22427e942 (127.2.55.129:41701)
I20260811 16:49:57.385959 21310 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:54241
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:49:57.408214 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.55.148:41101/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41375
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:38655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 16:49:57 dist-test-slave-3h5h krb5kdc[20506](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786466997, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 16:49:57.544607 21672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:49:57.544910 21672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:49:57.544955 21672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:49:57.546792 21672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:49:57.546854 21672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:49:57.546893 21672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:49:57.549432 21672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:38655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.2.55.148:41101/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41375
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:49:57.549696 21672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:49:57.549964 21672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:49:57.556682 21689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:57.557022 21687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:57.558458 21672 server_base.cc:1034] running on GCE node
W20260811 16:49:57.558696 21695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:57.559005 21672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:49:57.559324 21672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:49:57.566689 21672 hybrid_clock.cc:648] HybridClock initialized: now 1786466997566659 us; error 47 us; skew 500 ppm
Aug 11 16:49:57 dist-test-slave-3h5h krb5kdc[20506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466997, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:49:57.570441 21672 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:49:57.571025 21672 webserver.cc:460] Webserver started at http://127.2.55.130:43569/ using document root <none> and password file <none>
I20260811 16:49:57.571324 21672 fs_manager.cc:359] Metadata directory not provided
I20260811 16:49:57.571398 21672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:49:57.571553 21672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:49:57 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466997, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
I20260811 16:49:57.590528 21672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "bea01ea1f33048df9182dbd1b55d44ad"
format_stamp: "Formatted at 2026-08-11 16:49:57 on dist-test-slave-3h5h"
server_key: "f9c18c7333f59aa181f629e81b389b13"
server_key_iv: "2e02e29fb85cc1caf261b37377254f49"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:57.591130 21672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "bea01ea1f33048df9182dbd1b55d44ad"
format_stamp: "Formatted at 2026-08-11 16:49:57 on dist-test-slave-3h5h"
server_key: "f9c18c7333f59aa181f629e81b389b13"
server_key_iv: "2e02e29fb85cc1caf261b37377254f49"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:57.593014 21672 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 16:49:57.606017 21707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:57.606444 21672 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:49:57.606567 21672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "bea01ea1f33048df9182dbd1b55d44ad"
format_stamp: "Formatted at 2026-08-11 16:49:57 on dist-test-slave-3h5h"
server_key: "f9c18c7333f59aa181f629e81b389b13"
server_key_iv: "2e02e29fb85cc1caf261b37377254f49"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:57.606664 21672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:49:57.619951 21672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:49:57.622219 21672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:49:57.622366 21672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:49:57.622671 21672 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:49:57.623018 21672 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:49:57.623061 21672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:57.623097 21672 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:49:57.623116 21672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:57.630434 21672 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:40917
I20260811 16:49:57.630849 21672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:49:57.632404 21918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:40917 every 8 connection(s)
I20260811 16:49:57.633579 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 21672
I20260811 16:49:57.633720 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:49:57.633908 2270 external_mini_cluster.cc:1428] Setting key d3eba65919dfb08babdc03c23112b139
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Aug 11 16:49:57 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466997, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:49:57.660166 21670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:57.633341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:35355 (local address 127.2.55.190:41375)
0811 16:49:57.633394 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:57.633397 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:57.634282 (+ 885us) server_negotiation.cc:407] Connection header received
0811 16:49:57.634576 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:57.634577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:57.634601 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:57.634666 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:49:57.648877 (+ 14211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:57.649697 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:57.651236 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:57.651517 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:57.651565 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:57.656492 (+ 4927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:49:57.656495 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:49:57.656495 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:49:57.656505 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:49:57.658319 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:57.658906 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:57.658907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:57.658908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:57.658977 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:57.659361 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:57.659363 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:57.659363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:57.659509 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:49:57.659560 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:57.659975 (+ 415us) server_negotiation.cc:299] Negotiation successful
0811 16:49:57.660074 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:49:57.660997 21923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:57.633320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:41375 (local address 127.2.55.130:35355)
0811 16:49:57.633598 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:57.633638 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:57.634247 (+ 609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:57.647733 (+ 13486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:57.647740 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:57.648016 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:49:57.648327 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:57.648333 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:57.649833 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:57.649834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:57.651124 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:57.651127 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:57.651724 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:57.651725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:57.651867 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:57.652499 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:49:57.652511 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:49:57.654437 (+ 1926us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:49:57.658463 (+ 4026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:57.658471 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:57.658475 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:57.658813 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:57.659080 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:57.659081 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:57.659081 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:57.659278 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:57.659612 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:49:57.659619 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:49:57.659812 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 16:49:57.660532 (+ 720us) client_negotiation.cc:240] Negotiation successful
0811 16:49:57.660719 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":84,"threads_started":1}
I20260811 16:49:57.662025 21921 heartbeater.cc:347] Connected to a master server at 127.2.55.190:41375
I20260811 16:49:57.662128 21921 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:57.662325 21921 heartbeater.cc:511] Master 127.2.55.190:41375 requested a full tablet report, sending...
I20260811 16:49:57.662773 21310 ts_manager.cc:194] Registered new tserver with Master: bea01ea1f33048df9182dbd1b55d44ad (127.2.55.130:40917)
I20260811 16:49:57.663251 21310 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:35355
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:49:57.671516 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.55.148:41101/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41375
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:38655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:49:57.801240 21927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:49:57.801532 21927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:49:57.801566 21927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:49:57.803407 21927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:49:57.803474 21927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:49:57.803517 21927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:49:57.805757 21927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:38655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.2.55.148:41101/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41375
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:49:57.806051 21927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:49:57.806322 21927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:49:57.813308 21940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:57.813645 21944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:57.813882 21939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:57.815016 21927 server_base.cc:1034] running on GCE node
I20260811 16:49:57.815279 21927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:49:57.815557 21927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:49:57.818878 21927 hybrid_clock.cc:648] HybridClock initialized: now 1786466997818850 us; error 37 us; skew 500 ppm
Aug 11 16:49:57 dist-test-slave-3h5h krb5kdc[20506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466997, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:49:57.822365 21927 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:49:57.822990 21927 webserver.cc:460] Webserver started at http://127.2.55.131:36271/ using document root <none> and password file <none>
I20260811 16:49:57.823309 21927 fs_manager.cc:359] Metadata directory not provided
I20260811 16:49:57.823385 21927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:49:57.823598 21927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:49:57 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466997, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
I20260811 16:49:57.843636 21927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "147af255058e4767b84fd51ac3bd1239"
format_stamp: "Formatted at 2026-08-11 16:49:57 on dist-test-slave-3h5h"
server_key: "6c02cf93bb2c87ccb3b73890e4585030"
server_key_iv: "f73daf53afc73d7c6d229ab06f9f1f63"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:57.844302 21927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "147af255058e4767b84fd51ac3bd1239"
format_stamp: "Formatted at 2026-08-11 16:49:57 on dist-test-slave-3h5h"
server_key: "6c02cf93bb2c87ccb3b73890e4585030"
server_key_iv: "f73daf53afc73d7c6d229ab06f9f1f63"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:57.847704 21927 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 16:49:57.867390 21959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:57.867616 21927 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:49:57.867735 21927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "147af255058e4767b84fd51ac3bd1239"
format_stamp: "Formatted at 2026-08-11 16:49:57 on dist-test-slave-3h5h"
server_key: "6c02cf93bb2c87ccb3b73890e4585030"
server_key_iv: "f73daf53afc73d7c6d229ab06f9f1f63"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:57.867867 21927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:49:57.895700 21927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:49:57.898176 21927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:49:57.898365 21927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:49:57.898649 21927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:49:57.899091 21927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:49:57.899153 21927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:57.899197 21927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:49:57.899226 21927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:57.919648 21927 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:42627
I20260811 16:49:57.920156 21927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:49:57.921212 22152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:42627 every 8 connection(s)
I20260811 16:49:57.927192 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 21927
I20260811 16:49:57.927294 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:49:57.927472 2270 external_mini_cluster.cc:1428] Setting key 4628e5b99106ade6999d12bace727a1a
Aug 11 16:49:57 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466997, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:49:57.938797 21670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:57.922186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:58545 (local address 127.2.55.190:41375)
0811 16:49:57.922235 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:57.922237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:57.922588 (+ 351us) server_negotiation.cc:407] Connection header received
0811 16:49:57.923350 (+ 762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:57.923351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:57.923364 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:57.923396 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:49:57.924283 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:57.925128 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:57.926666 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:57.926952 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:57.927040 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:57.935206 (+ 8166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:49:57.935207 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:49:57.935208 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:49:57.935217 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:49:57.937062 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:57.937603 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:57.937604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:57.937604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:57.937672 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:57.938003 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:57.938004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:57.938005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:57.938147 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:49:57.938218 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:57.938589 (+ 371us) server_negotiation.cc:299] Negotiation successful
0811 16:49:57.938676 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:49:57.938988 22156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:57.921874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:41375 (local address 127.2.55.131:58545)
0811 16:49:57.922440 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:57.922483 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:57.923161 (+ 678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:57.923601 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:57.923606 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:57.923865 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:49:57.924146 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:57.924152 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:57.925278 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:57.925279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:57.926558 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:57.926561 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:57.927139 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:57.927140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:57.927281 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:57.927932 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:49:57.928007 (+ 75us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:49:57.935070 (+ 7063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:49:57.937158 (+ 2088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:57.937168 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:57.937171 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:57.937512 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:57.937758 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:57.937759 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:57.937759 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:57.937920 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:57.938231 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:49:57.938239 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:49:57.938419 (+ 180us) client_negotiation.cc:769] Sending connection context
0811 16:49:57.938555 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 16:49:57.938738 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":101,"threads_started":1}
I20260811 16:49:57.939867 22153 heartbeater.cc:347] Connected to a master server at 127.2.55.190:41375
I20260811 16:49:57.940227 22153 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:57.940541 22153 heartbeater.cc:511] Master 127.2.55.190:41375 requested a full tablet report, sending...
I20260811 16:49:57.941030 21310 ts_manager.cc:194] Registered new tserver with Master: 147af255058e4767b84fd51ac3bd1239 (127.2.55.131:42627)
I20260811 16:49:57.941548 21310 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:58545
I20260811 16:49:57.951313 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:49:57.952051 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 21451
I20260811 16:49:58.001448 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 21672
I20260811 16:49:58.017706 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 21927
I20260811 16:49:58.026194 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 21250
I20260811 16:49:58.052557 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:41375
--webserver_interface=127.2.55.190
--webserver_port=38263
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:38655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:41375
--ranger_config_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.55.148:41101/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.2.55.148:41101/kms with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:49:58.145707 22161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:49:58.145938 22161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:49:58.145963 22161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:49:58.147264 22161 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:49:58.147312 22161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:49:58.147328 22161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:49:58.147342 22161 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:49:58.147356 22161 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:49:58.149299 22161 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:38655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.2.55.148:41101/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:41375
--ranger_config_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:41375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=38263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:49:58.149569 22161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:49:58.149852 22161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:49:58.155174 22171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:58.155261 22177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:58.155428 22161 server_base.cc:1034] running on GCE node
W20260811 16:49:58.155274 22174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:58.155732 22161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:49:58.156064 22161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:49:58.157249 22161 hybrid_clock.cc:648] HybridClock initialized: now 1786466998157232 us; error 28 us; skew 500 ppm
Aug 11 16:49:58 dist-test-slave-3h5h krb5kdc[20506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466998, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:49:58.165548 22161 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:49:58.166064 22161 webserver.cc:460] Webserver started at http://127.2.55.190:38263/ using document root <none> and password file <none>
I20260811 16:49:58.166369 22161 fs_manager.cc:359] Metadata directory not provided
I20260811 16:49:58.166457 22161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 16:49:58 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466998, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
I20260811 16:49:58.215080 22161 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:49:58.215924 22188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:58.216223 22161 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:49:58.216358 22161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "57bc7db2d8c94b54a231c3896d981861"
format_stamp: "Formatted at 2026-08-11 16:49:56 on dist-test-slave-3h5h"
server_key: "40806c2b0cb74c921693ac576a3a0d92"
server_key_iv: "84334e3c6c5d7c2c1bf91e00dbc10eb4"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:58.216768 22161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:49:58.231822 22161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:49:58.234223 22161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:49:58.234409 22161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:49:58.240016 22161 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:41375
I20260811 16:49:58.240054 22286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:41375 every 8 connection(s)
I20260811 16:49:58.240478 22161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:49:58.241878 22287 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:49:58.242643 22287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861: Bootstrap starting.
I20260811 16:49:58.249755 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 22161
I20260811 16:49:58.250113 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.55.148:41101/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:41701
--local_ip_for_outbound_sockets=127.2.55.129
--tserver_master_addrs=127.2.55.190:41375
--webserver_port=46785
--webserver_interface=127.2.55.129
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:38655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.2.55.148:41101/kms with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:49:58.251811 22287 log.cc:824] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861: Log is configured to *not* fsync() on all Append() calls
I20260811 16:49:58.254706 22287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:49:58.255096 22287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861: Bootstrap complete.
I20260811 16:49:58.259634 22287 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57bc7db2d8c94b54a231c3896d981861" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41375 } }
I20260811 16:49:58.260075 22287 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57bc7db2d8c94b54a231c3896d981861, State: Initialized, Role: FOLLOWER
I20260811 16:49:58.260305 22287 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57bc7db2d8c94b54a231c3896d981861" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41375 } }
I20260811 16:49:58.260409 22287 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:49:58.260483 22287 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:49:58.260552 22287 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:49:58.262331 22287 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57bc7db2d8c94b54a231c3896d981861" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41375 } }
I20260811 16:49:58.262481 22287 leader_election.cc:302] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57bc7db2d8c94b54a231c3896d981861; no voters:
I20260811 16:49:58.262712 22287 leader_election.cc:288] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 16:49:58.262841 22295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:49:58.263026 22287 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:49:58.263083 22295 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [term 2 LEADER]: Becoming Leader. State: Replica: 57bc7db2d8c94b54a231c3896d981861, State: Running, Role: LEADER
I20260811 16:49:58.263264 22295 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57bc7db2d8c94b54a231c3896d981861" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41375 } }
I20260811 16:49:58.263562 22297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57bc7db2d8c94b54a231c3896d981861. Latest consensus state: current_term: 2 leader_uuid: "57bc7db2d8c94b54a231c3896d981861" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57bc7db2d8c94b54a231c3896d981861" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41375 } } }
I20260811 16:49:58.263672 22297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [sys.catalog]: This master's current role is: LEADER
I20260811 16:49:58.263553 22296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "57bc7db2d8c94b54a231c3896d981861" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57bc7db2d8c94b54a231c3896d981861" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41375 } } }
I20260811 16:49:58.263828 22296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861 [sys.catalog]: This master's current role is: LEADER
I20260811 16:49:58.264436 22306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:49:58.265021 22306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:49:58.265174 22306 catalog_manager.cc:1259] Loaded cluster ID: b4221da811d645afa13f39f631b6c907
I20260811 16:49:58.265223 22306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:49:58.265583 22287 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 16:49:58.266393 22306 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:49:58.266623 22306 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861: Loaded TSK: 0
I20260811 16:49:58.266860 22306 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 16:49:58.372233 22289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:49:58.372536 22289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:49:58.372582 22289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:49:58.374280 22289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:49:58.374353 22289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:49:58.374400 22289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:49:58.376485 22289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:38655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.2.55.148:41101/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:41701
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=46785
--tserver_master_addrs=127.2.55.190:41375
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:49:58.376754 22289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:49:58.377084 22289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:49:58.384354 22361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:58.384356 22356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:58.384757 22289 server_base.cc:1034] running on GCE node
W20260811 16:49:58.384416 22354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:58.385061 22289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:49:58.385370 22289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:49:58.386569 22289 hybrid_clock.cc:648] HybridClock initialized: now 1786466998386535 us; error 50 us; skew 500 ppm
Aug 11 16:49:58 dist-test-slave-3h5h krb5kdc[20506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466998, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:49:58.390340 22289 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:49:58.390962 22289 webserver.cc:460] Webserver started at http://127.2.55.129:46785/ using document root <none> and password file <none>
I20260811 16:49:58.391376 22289 fs_manager.cc:359] Metadata directory not provided
I20260811 16:49:58.391477 22289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 16:49:58 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466998, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
I20260811 16:49:58.413985 22289 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.001s sys 0.000s
I20260811 16:49:58.419557 22374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:58.419813 22289 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.000s
I20260811 16:49:58.419956 22289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "2be13503ec6c4cdabaa5dab22427e942"
format_stamp: "Formatted at 2026-08-11 16:49:57 on dist-test-slave-3h5h"
server_key: "0e085a1063d718a49c081d39406cc56a"
server_key_iv: "a98e85c6aa35858fcc184ce4fcfaaae5"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:58.420439 22289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:49:58.456037 22289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:49:58.458563 22289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:49:58.458753 22289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:49:58.459089 22289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:49:58.459537 22289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:49:58.459600 22289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:58.459646 22289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:49:58.459676 22289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:58.468127 22289 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:41701
I20260811 16:49:58.468281 22567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:41701 every 8 connection(s)
I20260811 16:49:58.468668 22289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:49:58 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466998, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:49:58.478838 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 22289
I20260811 16:49:58.479211 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.55.148:41101/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:40917
--local_ip_for_outbound_sockets=127.2.55.130
--tserver_master_addrs=127.2.55.190:41375
--webserver_port=43569
--webserver_interface=127.2.55.130
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:38655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.2.55.148:41101/kms with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:49:58.482481 22575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:58.469849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:48759 (local address 127.2.55.190:41375)
0811 16:49:58.470102 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:58.470110 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:58.470355 (+ 245us) server_negotiation.cc:407] Connection header received
0811 16:49:58.471141 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:58.471147 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:58.471196 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:58.471348 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:49:58.471967 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:58.473073 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:58.474241 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:58.474706 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:58.474844 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:58.477244 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:49:58.477257 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:49:58.477257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:49:58.477270 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:49:58.480028 (+ 2758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:58.480620 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:58.480624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:58.480624 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:58.480748 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:58.481132 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:58.481133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:58.481134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:58.481481 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:49:58.481599 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:58.482015 (+ 416us) server_negotiation.cc:299] Negotiation successful
0811 16:49:58.482184 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":98,"threads_started":1}
I20260811 16:49:58.483081 22573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:58.469755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:41375 (local address 127.2.55.129:48759)
0811 16:49:58.470187 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:58.470224 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:58.470867 (+ 643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:58.471391 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:58.471396 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:58.471625 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:49:58.471834 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:58.471839 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:58.473193 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:58.473194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:58.474123 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:58.474126 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:58.474832 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:58.474833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:58.474984 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:58.475609 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:49:58.475619 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:49:58.477111 (+ 1492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:49:58.480141 (+ 3030us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:58.480149 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:58.480152 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:58.480515 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:58.480865 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:58.480866 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:58.480867 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:58.481041 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:58.481575 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:49:58.481583 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:49:58.481779 (+ 196us) client_negotiation.cc:769] Sending connection context
0811 16:49:58.482629 (+ 850us) client_negotiation.cc:240] Negotiation successful
0811 16:49:58.482826 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":96,"threads_started":1}
I20260811 16:49:58.484066 22568 heartbeater.cc:347] Connected to a master server at 127.2.55.190:41375
I20260811 16:49:58.484215 22568 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:58.484423 22568 heartbeater.cc:511] Master 127.2.55.190:41375 requested a full tablet report, sending...
W20260811 16:49:58.485484 22568 heartbeater.cc:644] Failed to heartbeat to 127.2.55.190:41375 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 16:49:58.485575 22568 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:58.485656 22568 heartbeater.cc:511] Master 127.2.55.190:41375 requested a full tablet report, sending...
I20260811 16:49:58.486069 22568 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:58.486177 22568 heartbeater.cc:511] Master 127.2.55.190:41375 requested a full tablet report, sending...
W20260811 16:49:58.486546 22568 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:49:58.605659 22576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:49:58.605981 22576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:49:58.606025 22576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:49:58.607733 22576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:49:58.607795 22576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:49:58.607827 22576 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:49:58.609789 22576 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:38655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.2.55.148:41101/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:40917
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=43569
--tserver_master_addrs=127.2.55.190:41375
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22576
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:49:58.610123 22576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:49:58.610404 22576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:49:58.617336 22584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:58.617369 22591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:58.617336 22586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:58.618011 22576 server_base.cc:1034] running on GCE node
I20260811 16:49:58.618247 22576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:49:58.618587 22576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:49:58.619801 22576 hybrid_clock.cc:648] HybridClock initialized: now 1786466998619787 us; error 29 us; skew 500 ppm
Aug 11 16:49:58 dist-test-slave-3h5h krb5kdc[20506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466998, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:49:58.623250 22576 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:49:58.623865 22576 webserver.cc:460] Webserver started at http://127.2.55.130:43569/ using document root <none> and password file <none>
I20260811 16:49:58.624137 22576 fs_manager.cc:359] Metadata directory not provided
I20260811 16:49:58.624208 22576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 16:49:58 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466998, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
I20260811 16:49:58.646811 22576 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.000s
I20260811 16:49:58.647965 22609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:58.648139 22576 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:49:58.648289 22576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "bea01ea1f33048df9182dbd1b55d44ad"
format_stamp: "Formatted at 2026-08-11 16:49:57 on dist-test-slave-3h5h"
server_key: "f9c18c7333f59aa181f629e81b389b13"
server_key_iv: "2e02e29fb85cc1caf261b37377254f49"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:58.648813 22576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:49:58.666383 22576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:49:58.668972 22576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:49:58.669127 22576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:49:58.669373 22576 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:49:58.669776 22576 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:49:58.669817 22576 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:58.669844 22576 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:49:58.669858 22576 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:58.678188 22576 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:40917
I20260811 16:49:58.678267 22784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:40917 every 8 connection(s)
I20260811 16:49:58.678659 22576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:49:58.680953 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 22576
I20260811 16:49:58.681306 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.55.148:41101/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:42627
--local_ip_for_outbound_sockets=127.2.55.131
--tserver_master_addrs=127.2.55.190:41375
--webserver_port=36271
--webserver_interface=127.2.55.131
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:38655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.2.55.148:41101/kms with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 16:49:58 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466998, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:49:58.691586 22791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:58.679539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:41375 (local address 127.2.55.130:34671)
0811 16:49:58.679723 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:58.679768 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:58.680312 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:58.680618 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:58.680623 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:58.680935 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:49:58.681318 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:58.681325 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:58.682494 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:58.682495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:58.683672 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:58.683676 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:58.684314 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:58.684316 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:58.684495 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:58.685191 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:49:58.685205 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:49:58.687099 (+ 1894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:49:58.689431 (+ 2332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:58.689440 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:58.689444 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:58.689858 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:58.690137 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:58.690138 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:58.690139 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:58.690304 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:58.690704 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:49:58.690712 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:49:58.690914 (+ 202us) client_negotiation.cc:769] Sending connection context
0811 16:49:58.691048 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 16:49:58.691246 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":104,"threads_started":1}
I20260811 16:49:58.692157 22575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:58.679532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:34671 (local address 127.2.55.190:41375)
0811 16:49:58.679594 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:58.679597 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:58.679885 (+ 288us) server_negotiation.cc:407] Connection header received
0811 16:49:58.680454 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:58.680456 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:58.680476 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:58.680531 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:49:58.681570 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:58.682345 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:58.683789 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:58.684123 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:58.684205 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:58.687242 (+ 3037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:49:58.687244 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:49:58.687244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:49:58.687256 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:49:58.689303 (+ 2047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:58.689971 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:58.689972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:58.689973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:58.690049 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:58.690396 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:58.690398 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:58.690398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:58.690591 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:49:58.690670 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:58.691905 (+ 1235us) server_negotiation.cc:299] Negotiation successful
0811 16:49:58.692018 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:49:58.692591 22785 heartbeater.cc:347] Connected to a master server at 127.2.55.190:41375
I20260811 16:49:58.692734 22785 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:58.692997 22785 heartbeater.cc:511] Master 127.2.55.190:41375 requested a full tablet report, sending...
W20260811 16:49:58.693876 22785 heartbeater.cc:644] Failed to heartbeat to 127.2.55.190:41375 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 16:49:58.693972 22785 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:58.694052 22785 heartbeater.cc:511] Master 127.2.55.190:41375 requested a full tablet report, sending...
I20260811 16:49:58.694429 22785 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:58.694527 22785 heartbeater.cc:511] Master 127.2.55.190:41375 requested a full tablet report, sending...
W20260811 16:49:58.694878 22785 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:49:58.788813 22792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:49:58.789158 22792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:49:58.789202 22792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:49:58.790560 22792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:49:58.790637 22792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:49:58.790686 22792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:49:58.792395 22792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:38655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.2.55.148:41101/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:42627
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=36271
--tserver_master_addrs=127.2.55.190:41375
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:49:58.792685 22792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:49:58.793043 22792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:49:58.800408 22799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:58.800408 22802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:49:58.800503 22800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:49:58.806247 22792 server_base.cc:1034] running on GCE node
I20260811 16:49:58.806509 22792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:49:58.806793 22792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:49:58.807988 22792 hybrid_clock.cc:648] HybridClock initialized: now 1786466998807952 us; error 49 us; skew 500 ppm
Aug 11 16:49:58 dist-test-slave-3h5h krb5kdc[20506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466998, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:49:58.811385 22792 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:49:58.811970 22792 webserver.cc:460] Webserver started at http://127.2.55.131:36271/ using document root <none> and password file <none>
I20260811 16:49:58.812273 22792 fs_manager.cc:359] Metadata directory not provided
I20260811 16:49:58.812565 22792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 16:49:58 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466998, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
I20260811 16:49:58.832429 22792 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:49:58.834566 22819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:58.834771 22792 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260811 16:49:58.834873 22792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "147af255058e4767b84fd51ac3bd1239"
format_stamp: "Formatted at 2026-08-11 16:49:57 on dist-test-slave-3h5h"
server_key: "6c02cf93bb2c87ccb3b73890e4585030"
server_key_iv: "f73daf53afc73d7c6d229ab06f9f1f63"
server_key_version: "kuduclusterkey@0"
I20260811 16:49:58.835371 22792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:49:58.870396 22792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:49:58.872545 22792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:49:58.872735 22792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:49:58.873042 22792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:49:58.873440 22792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:49:58.873497 22792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:58.873538 22792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:49:58.873566 22792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:49:58.882550 22792 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:42627
I20260811 16:49:58.882995 22792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:49:58.883689 23026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:42627 every 8 connection(s)
Aug 11 16:49:58 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466998, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:49:58.892114 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 22792
I20260811 16:49:58.894762 22575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:58.884955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:44313 (local address 127.2.55.190:41375)
0811 16:49:58.885032 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:58.885034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:58.885044 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:49:58.885074 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:58.885075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:58.885086 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:58.885151 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:49:58.885979 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:58.886687 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:58.888189 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:58.888475 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:58.888525 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:58.891326 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:49:58.891328 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:49:58.891328 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:49:58.891338 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:49:58.893154 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:58.893651 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:58.893652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:58.893653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:58.893728 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:58.894013 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:58.894014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:58.894014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:58.894160 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:49:58.894202 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:58.894576 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 16:49:58.894666 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 16:49:58.895547 23029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:58.883880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:41375 (local address 127.2.55.131:44313)
0811 16:49:58.884039 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:58.884084 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:58.884703 (+ 619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:58.885289 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:58.885294 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:58.885543 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:49:58.885856 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:58.885863 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:58.886810 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:58.886811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:58.888064 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:58.888067 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:58.888649 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:58.888650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:58.888794 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:58.889459 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:49:58.889469 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:49:58.891198 (+ 1729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:49:58.893247 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:58.893253 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:58.893256 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:58.893555 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:58.893804 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:49:58.893805 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:49:58.893805 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:49:58.893938 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:49:58.894250 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:49:58.894257 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:49:58.894418 (+ 161us) client_negotiation.cc:769] Sending connection context
0811 16:49:58.895132 (+ 714us) client_negotiation.cc:240] Negotiation successful
0811 16:49:58.895300 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":92,"threads_started":1}
I20260811 16:49:58.896237 23027 heartbeater.cc:347] Connected to a master server at 127.2.55.190:41375
I20260811 16:49:58.896382 23027 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:58.896628 23027 heartbeater.cc:511] Master 127.2.55.190:41375 requested a full tablet report, sending...
W20260811 16:49:58.897313 23027 heartbeater.cc:644] Failed to heartbeat to 127.2.55.190:41375 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 16:49:58.897439 23027 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:58.897553 23027 heartbeater.cc:511] Master 127.2.55.190:41375 requested a full tablet report, sending...
I20260811 16:49:58.897859 23027 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:58.897938 23027 heartbeater.cc:511] Master 127.2.55.190:41375 requested a full tablet report, sending...
W20260811 16:49:58.898240 23027 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 16:49:58.913105 22575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:58.892816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52208 (local address 127.2.55.190:41375)
0811 16:49:58.894836 (+ 2020us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:58.894838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:58.901066 (+ 6228us) server_negotiation.cc:407] Connection header received
0811 16:49:58.901158 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:58.901158 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:58.901170 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:58.901221 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:49:58.904928 (+ 3707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:58.905513 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:58.906425 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:58.906678 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:58.906744 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:58.908651 (+ 1907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:49:58.908653 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:49:58.908653 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:49:58.908661 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:49:58.910162 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:58.910548 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:58.910549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:58.910550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:58.910605 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:58.910838 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:58.910839 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:58.910839 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:58.910972 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:49:58.911172 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:58.912913 (+ 1741us) server_negotiation.cc:299] Negotiation successful
0811 16:49:58.913001 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2005,"thread_start_us":84,"threads_started":1}
I20260811 16:49:59.486781 22568 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:59.486994 22568 heartbeater.cc:511] Master 127.2.55.190:41375 requested a full tablet report, sending...
I20260811 16:49:59.487496 22215 ts_manager.cc:194] Registered new tserver with Master: 2be13503ec6c4cdabaa5dab22427e942 (127.2.55.129:41701)
I20260811 16:49:59.488226 22215 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:48759
Aug 11 16:49:59 dist-test-slave-3h5h krb5kdc[20506](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786466999, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:49:59.695086 22785 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:59.695274 22785 heartbeater.cc:511] Master 127.2.55.190:41375 requested a full tablet report, sending...
I20260811 16:49:59.695570 22215 ts_manager.cc:194] Registered new tserver with Master: bea01ea1f33048df9182dbd1b55d44ad (127.2.55.130:40917)
I20260811 16:49:59.696120 22215 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:34671
Aug 11 16:49:59 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466999, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
I20260811 16:49:59.899528 23027 heartbeater.cc:464] Registering TS with master...
I20260811 16:49:59.899716 23027 heartbeater.cc:511] Master 127.2.55.190:41375 requested a full tablet report, sending...
I20260811 16:49:59.900066 22215 ts_manager.cc:194] Registered new tserver with Master: 147af255058e4767b84fd51ac3bd1239 (127.2.55.131:42627)
I20260811 16:49:59.900496 22215 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:44313
I20260811 16:49:59.902208 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:49:59.918126 23061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:59.906487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52214 (local address 127.2.55.190:41375)
0811 16:49:59.908888 (+ 2401us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:59.908891 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:59.909071 (+ 180us) server_negotiation.cc:407] Connection header received
0811 16:49:59.909436 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:59.909437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:59.909453 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:59.909552 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:49:59.910281 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:59.911087 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:59.912176 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:59.912508 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:59.912589 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:59.914209 (+ 1620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:49:59.914211 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:49:59.914211 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:49:59.914220 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:49:59.916528 (+ 2308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:59.917060 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:59.917061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:59.917061 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:59.917154 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:49:59.917382 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:49:59.917383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:49:59.917383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:49:59.917524 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:49:59.917622 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:59.917849 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 16:49:59.917938 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1203,"thread_start_us":94,"threads_started":1}
I20260811 16:49:59.920418 22215 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52214:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:49:59.923249 22215 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:49:59.940644 23078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:59.927800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:41701 (local address 127.0.0.1:58512)
0811 16:49:59.929870 (+ 2070us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:59.929880 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:59.929933 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:59.931752 (+ 1819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:59.931756 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:59.931760 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:49:59.931850 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:59.931852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:59.934093 (+ 2241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:59.934094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:59.935606 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:59.935610 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:59.940207 (+ 4597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:59.940208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:59.940354 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:59.940377 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 16:49:59.940475 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 16:49:59.940539 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2049,"thread_start_us":121,"threads_started":1}
I20260811 16:49:59.941080 23082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:59.928189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58512 (local address 127.2.55.129:41701)
0811 16:49:59.928382 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:59.928387 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:59.930012 (+ 1625us) server_negotiation.cc:407] Connection header received
0811 16:49:59.930064 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:59.930067 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:59.930086 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:59.930757 (+ 671us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:49:59.931957 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:59.933600 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:59.936201 (+ 2601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:59.940017 (+ 3816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:59.940098 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:59.940166 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:59.940936 (+ 770us) server_negotiation.cc:299] Negotiation successful
0811 16:49:59.940988 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":104,"threads_started":1}
I20260811 16:49:59.941938 23081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:59.928041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:40917 (local address 127.0.0.1:46590)
0811 16:49:59.937333 (+ 9292us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:59.937349 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:59.937416 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:59.937755 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:59.937757 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:59.937759 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:49:59.937809 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:59.937811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:59.939141 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:59.939142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:59.940397 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:59.940399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:59.941645 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:59.941646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:59.941696 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:59.941700 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:49:59.941817 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 16:49:59.941861 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9266,"thread_start_us":73,"threads_started":1}
I20260811 16:49:59.941972 23084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:59.928402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46590 (local address 127.2.55.130:40917)
0811 16:49:59.928586 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:59.928590 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:59.937503 (+ 8913us) server_negotiation.cc:407] Connection header received
0811 16:49:59.937554 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:59.937556 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:59.937574 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:59.937657 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:49:59.937902 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:59.939012 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:59.940510 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:59.941431 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:59.941519 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:59.941583 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:59.941839 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 16:49:59.941883 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":91,"threads_started":1}
I20260811 16:49:59.941884 22457 tablet_service.cc:1467] Processing CreateTablet for tablet c2c580c98ecc4c08a985cced540a1f22 (DEFAULT_TABLE table=test-table [id=4986daf3ef6e486fbe41610a6f4ba228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:49:59.942337 22457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2c580c98ecc4c08a985cced540a1f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:49:59.942719 22666 tablet_service.cc:1467] Processing CreateTablet for tablet c2c580c98ecc4c08a985cced540a1f22 (DEFAULT_TABLE table=test-table [id=4986daf3ef6e486fbe41610a6f4ba228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:49:59.943096 22666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2c580c98ecc4c08a985cced540a1f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:49:59.948647 23080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:59.927798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:42627 (local address 127.0.0.1:48176)
0811 16:49:59.929322 (+ 1524us) negotiation.cc:107] Waiting for socket to connect
0811 16:49:59.929643 (+ 321us) client_negotiation.cc:174] Beginning negotiation
0811 16:49:59.929730 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:49:59.937183 (+ 7453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:49:59.937184 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:49:59.937187 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:49:59.937236 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:59.937238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:59.938585 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:59.938586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:59.939815 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:49:59.939818 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:49:59.948370 (+ 8552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:49:59.948371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:49:59.948460 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:59.948466 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:49:59.948510 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 16:49:59.948561 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1486,"thread_start_us":96,"threads_started":1}
I20260811 16:49:59.949048 23086 tablet_bootstrap.cc:492] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad: Bootstrap starting.
I20260811 16:49:59.949728 23083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:49:59.928266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48176 (local address 127.2.55.131:42627)
0811 16:49:59.936964 (+ 8698us) server_negotiation.cc:206] Beginning negotiation
0811 16:49:59.936971 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:49:59.936986 (+ 15us) server_negotiation.cc:407] Connection header received
0811 16:49:59.937030 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:49:59.937033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:49:59.937054 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:49:59.937173 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:49:59.937339 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:59.938421 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:59.947403 (+ 8982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:49:59.948238 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:49:59.949059 (+ 821us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:49:59.949203 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 16:49:59.949233 (+ 30us) server_negotiation.cc:299] Negotiation successful
0811 16:49:59.949283 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8634,"thread_start_us":64,"threads_started":1}
I20260811 16:49:59.949994 23086 tablet_bootstrap.cc:654] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad: Neither blocks nor log segments found. Creating new log.
I20260811 16:49:59.950392 23086 log.cc:824] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad: Log is configured to *not* fsync() on all Append() calls
I20260811 16:49:59.950673 22891 tablet_service.cc:1467] Processing CreateTablet for tablet c2c580c98ecc4c08a985cced540a1f22 (DEFAULT_TABLE table=test-table [id=4986daf3ef6e486fbe41610a6f4ba228]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:49:59.951010 22891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2c580c98ecc4c08a985cced540a1f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:49:59.954638 23091 tablet_bootstrap.cc:492] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239: Bootstrap starting.
I20260811 16:49:59.955011 23087 tablet_bootstrap.cc:492] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942: Bootstrap starting.
I20260811 16:49:59.955371 23091 tablet_bootstrap.cc:654] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239: Neither blocks nor log segments found. Creating new log.
I20260811 16:49:59.955760 23091 log.cc:824] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239: Log is configured to *not* fsync() on all Append() calls
I20260811 16:49:59.956236 23087 tablet_bootstrap.cc:654] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942: Neither blocks nor log segments found. Creating new log.
I20260811 16:49:59.956629 23087 log.cc:824] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942: Log is configured to *not* fsync() on all Append() calls
I20260811 16:49:59.957499 23087 tablet_bootstrap.cc:492] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942: No bootstrap required, opened a new log
I20260811 16:49:59.957571 23087 ts_tablet_manager.cc:1397] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260811 16:49:59.957597 23086 tablet_bootstrap.cc:492] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad: No bootstrap required, opened a new log
I20260811 16:49:59.957671 23086 ts_tablet_manager.cc:1397] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260811 16:49:59.960176 23087 raft_consensus.cc:348] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147af255058e4767b84fd51ac3bd1239" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42627 } } peers { permanent_uuid: "bea01ea1f33048df9182dbd1b55d44ad" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40917 } } peers { permanent_uuid: "2be13503ec6c4cdabaa5dab22427e942" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41701 } }
I20260811 16:49:59.960338 23087 raft_consensus.cc:374] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:49:59.960368 23087 raft_consensus.cc:729] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2be13503ec6c4cdabaa5dab22427e942, State: Initialized, Role: FOLLOWER
I20260811 16:49:59.960496 23087 consensus_queue.cc:260] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147af255058e4767b84fd51ac3bd1239" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42627 } } peers { permanent_uuid: "bea01ea1f33048df9182dbd1b55d44ad" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40917 } } peers { permanent_uuid: "2be13503ec6c4cdabaa5dab22427e942" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41701 } }
I20260811 16:49:59.960743 23087 ts_tablet_manager.cc:1428] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 16:49:59.960881 23086 raft_consensus.cc:348] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147af255058e4767b84fd51ac3bd1239" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42627 } } peers { permanent_uuid: "bea01ea1f33048df9182dbd1b55d44ad" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40917 } } peers { permanent_uuid: "2be13503ec6c4cdabaa5dab22427e942" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41701 } }
I20260811 16:49:59.961071 23086 raft_consensus.cc:374] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:49:59.961117 23086 raft_consensus.cc:729] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea01ea1f33048df9182dbd1b55d44ad, State: Initialized, Role: FOLLOWER
I20260811 16:49:59.961184 22568 heartbeater.cc:503] Master 127.2.55.190:41375 was elected leader, sending a full tablet report...
I20260811 16:49:59.961269 23086 consensus_queue.cc:260] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147af255058e4767b84fd51ac3bd1239" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42627 } } peers { permanent_uuid: "bea01ea1f33048df9182dbd1b55d44ad" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40917 } } peers { permanent_uuid: "2be13503ec6c4cdabaa5dab22427e942" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41701 } }
I20260811 16:49:59.961567 23086 ts_tablet_manager.cc:1428] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 16:49:59.961692 22785 heartbeater.cc:503] Master 127.2.55.190:41375 was elected leader, sending a full tablet report...
I20260811 16:49:59.962749 23091 tablet_bootstrap.cc:492] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239: No bootstrap required, opened a new log
I20260811 16:49:59.962836 23091 ts_tablet_manager.cc:1397] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260811 16:49:59.965693 23091 raft_consensus.cc:348] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147af255058e4767b84fd51ac3bd1239" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42627 } } peers { permanent_uuid: "bea01ea1f33048df9182dbd1b55d44ad" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40917 } } peers { permanent_uuid: "2be13503ec6c4cdabaa5dab22427e942" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41701 } }
I20260811 16:49:59.965900 23091 raft_consensus.cc:374] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:49:59.965937 23091 raft_consensus.cc:729] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 147af255058e4767b84fd51ac3bd1239, State: Initialized, Role: FOLLOWER
I20260811 16:49:59.966071 23091 consensus_queue.cc:260] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147af255058e4767b84fd51ac3bd1239" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42627 } } peers { permanent_uuid: "bea01ea1f33048df9182dbd1b55d44ad" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40917 } } peers { permanent_uuid: "2be13503ec6c4cdabaa5dab22427e942" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41701 } }
I20260811 16:49:59.966387 23091 ts_tablet_manager.cc:1428] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 16:49:59.966410 23027 heartbeater.cc:503] Master 127.2.55.190:41375 was elected leader, sending a full tablet report...
W20260811 16:49:59.970489 22570 tablet.cc:2369] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:50:00.134848 23028 tablet.cc:2369] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:50:00.180390 22788 tablet.cc:2369] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 16:50:00 dist-test-slave-3h5h krb5kdc[20506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466999, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for HTTP/127.2.55.148@KRBTEST.COM
I20260811 16:50:00.227702 23098 raft_consensus.cc:482] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:50:00.227873 23098 raft_consensus.cc:504] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147af255058e4767b84fd51ac3bd1239" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42627 } } peers { permanent_uuid: "bea01ea1f33048df9182dbd1b55d44ad" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40917 } } peers { permanent_uuid: "2be13503ec6c4cdabaa5dab22427e942" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41701 } }
I20260811 16:50:00.228374 23098 leader_election.cc:288] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 147af255058e4767b84fd51ac3bd1239 (127.2.55.131:42627), bea01ea1f33048df9182dbd1b55d44ad (127.2.55.130:40917)
I20260811 16:50:00.238674 23100 raft_consensus.cc:482] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:50:00.238818 23100 raft_consensus.cc:504] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147af255058e4767b84fd51ac3bd1239" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42627 } } peers { permanent_uuid: "bea01ea1f33048df9182dbd1b55d44ad" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40917 } } peers { permanent_uuid: "2be13503ec6c4cdabaa5dab22427e942" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41701 } }
I20260811 16:50:00.239218 23100 leader_election.cc:288] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bea01ea1f33048df9182dbd1b55d44ad (127.2.55.130:40917), 2be13503ec6c4cdabaa5dab22427e942 (127.2.55.129:41701)
I20260811 16:50:00.241276 23083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:00.228962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:54485 (local address 127.2.55.131:42627)
0811 16:50:00.229010 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:00.229012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:00.237097 (+ 8085us) server_negotiation.cc:407] Connection header received
0811 16:50:00.237364 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:00.237366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:00.237380 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:00.237432 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:00.237676 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.238469 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.240088 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.240693 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.240745 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:00.240754 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:00.241162 (+ 408us) server_negotiation.cc:299] Negotiation successful
0811 16:50:00.241208 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:50:00.241557 23102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:00.228541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:42627 (local address 127.2.55.129:54485)
0811 16:50:00.236974 (+ 8433us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:00.236989 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:00.237290 (+ 301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:00.237483 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:00.237484 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:00.237487 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:00.237588 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:00.237591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.238672 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.238673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:00.239986 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:00.239990 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.240878 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.240879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:00.241059 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:00.241063 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:50:00.241399 (+ 336us) client_negotiation.cc:240] Negotiation successful
0811 16:50:00.241443 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8403,"thread_start_us":99,"threads_started":1}
I20260811 16:50:00.241896 22928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2c580c98ecc4c08a985cced540a1f22" candidate_uuid: "2be13503ec6c4cdabaa5dab22427e942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "147af255058e4767b84fd51ac3bd1239" is_pre_election: true
I20260811 16:50:00.241933 23084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:00.228972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:54211 (local address 127.2.55.130:40917)
0811 16:50:00.229027 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:00.229030 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:00.237221 (+ 8191us) server_negotiation.cc:407] Connection header received
0811 16:50:00.237307 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:00.237308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:00.237327 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:00.237378 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:00.238166 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.238883 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.241006 (+ 2123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.241559 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.241609 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:00.241617 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:00.241827 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 16:50:00.241871 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 16:50:00.242033 22928 raft_consensus.cc:2454] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2be13503ec6c4cdabaa5dab22427e942 in term 0.
I20260811 16:50:00.242220 23103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:00.228745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:40917 (local address 127.2.55.129:54211)
0811 16:50:00.237161 (+ 8416us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:00.237170 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:00.237237 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:00.237995 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:00.237997 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:00.238000 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:00.238071 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:00.238073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.239372 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.239373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:00.240904 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:00.240908 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.241677 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.241678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:00.241750 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:00.241753 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:50:00.242051 (+ 298us) client_negotiation.cc:240] Negotiation successful
0811 16:50:00.242139 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8399,"thread_start_us":75,"threads_started":1}
I20260811 16:50:00.242321 22375 leader_election.cc:302] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 147af255058e4767b84fd51ac3bd1239, 2be13503ec6c4cdabaa5dab22427e942; no voters:
I20260811 16:50:00.242527 23098 raft_consensus.cc:2781] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:50:00.242592 23098 raft_consensus.cc:482] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:50:00.242627 23098 raft_consensus.cc:3037] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:00.242707 22712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2c580c98ecc4c08a985cced540a1f22" candidate_uuid: "2be13503ec6c4cdabaa5dab22427e942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea01ea1f33048df9182dbd1b55d44ad" is_pre_election: true
I20260811 16:50:00.242867 22712 raft_consensus.cc:2454] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2be13503ec6c4cdabaa5dab22427e942 in term 0.
I20260811 16:50:00.243531 23098 raft_consensus.cc:504] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147af255058e4767b84fd51ac3bd1239" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42627 } } peers { permanent_uuid: "bea01ea1f33048df9182dbd1b55d44ad" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40917 } } peers { permanent_uuid: "2be13503ec6c4cdabaa5dab22427e942" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41701 } }
I20260811 16:50:00.243673 23098 leader_election.cc:288] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [CANDIDATE]: Term 1 election: Requested vote from peers 147af255058e4767b84fd51ac3bd1239 (127.2.55.131:42627), bea01ea1f33048df9182dbd1b55d44ad (127.2.55.130:40917)
I20260811 16:50:00.243889 22712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2c580c98ecc4c08a985cced540a1f22" candidate_uuid: "2be13503ec6c4cdabaa5dab22427e942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea01ea1f33048df9182dbd1b55d44ad"
I20260811 16:50:00.243889 22928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2c580c98ecc4c08a985cced540a1f22" candidate_uuid: "2be13503ec6c4cdabaa5dab22427e942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "147af255058e4767b84fd51ac3bd1239"
I20260811 16:50:00.243963 22928 raft_consensus.cc:3037] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:00.243963 22712 raft_consensus.cc:3037] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:00.244858 22712 raft_consensus.cc:2454] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be13503ec6c4cdabaa5dab22427e942 in term 1.
I20260811 16:50:00.244863 22928 raft_consensus.cc:2454] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2be13503ec6c4cdabaa5dab22427e942 in term 1.
I20260811 16:50:00.245102 22375 leader_election.cc:302] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2be13503ec6c4cdabaa5dab22427e942, bea01ea1f33048df9182dbd1b55d44ad; no voters:
I20260811 16:50:00.245230 23098 raft_consensus.cc:2781] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:50:00.245400 23098 raft_consensus.cc:686] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [term 1 LEADER]: Becoming Leader. State: Replica: 2be13503ec6c4cdabaa5dab22427e942, State: Running, Role: LEADER
I20260811 16:50:00.245504 23098 consensus_queue.cc:237] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147af255058e4767b84fd51ac3bd1239" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42627 } } peers { permanent_uuid: "bea01ea1f33048df9182dbd1b55d44ad" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40917 } } peers { permanent_uuid: "2be13503ec6c4cdabaa5dab22427e942" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41701 } }
I20260811 16:50:00.246358 22215 catalog_manager.cc:5495] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2be13503ec6c4cdabaa5dab22427e942 (127.2.55.129). New cstate: current_term: 1 leader_uuid: "2be13503ec6c4cdabaa5dab22427e942" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "147af255058e4767b84fd51ac3bd1239" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bea01ea1f33048df9182dbd1b55d44ad" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2be13503ec6c4cdabaa5dab22427e942" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 41701 } health_report { overall_health: HEALTHY } } }
I20260811 16:50:00.247721 23084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:00.239799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:45631 (local address 127.2.55.130:40917)
0811 16:50:00.242035 (+ 2236us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:00.242037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:00.242408 (+ 371us) server_negotiation.cc:407] Connection header received
0811 16:50:00.242503 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:00.242503 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:00.242513 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:00.242552 (+ 39us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:00.243206 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.243903 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.245355 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.245949 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.245998 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:00.246006 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:00.247609 (+ 1603us) server_negotiation.cc:299] Negotiation successful
0811 16:50:00.247656 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2221,"thread_start_us":78,"threads_started":1}
I20260811 16:50:00.247982 23109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:00.239566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:40917 (local address 127.2.55.131:45631)
0811 16:50:00.242336 (+ 2770us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:00.242348 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:00.242434 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:00.243043 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:00.243044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:00.243046 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:00.243118 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:00.243119 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.244016 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.244017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:00.245251 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:00.245255 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.246091 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.246092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:00.246165 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:00.246168 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:50:00.247833 (+ 1665us) client_negotiation.cc:240] Negotiation successful
0811 16:50:00.247886 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2751,"thread_start_us":116,"threads_started":1}
I20260811 16:50:00.248366 22712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2c580c98ecc4c08a985cced540a1f22" candidate_uuid: "147af255058e4767b84fd51ac3bd1239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bea01ea1f33048df9182dbd1b55d44ad" is_pre_election: true
I20260811 16:50:00.248466 22712 raft_consensus.cc:2379] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 147af255058e4767b84fd51ac3bd1239 in current term 1: Already voted for candidate 2be13503ec6c4cdabaa5dab22427e942 in this term.
I20260811 16:50:00.251401 23082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:00.240179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:58711 (local address 127.2.55.129:41701)
0811 16:50:00.240217 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:00.240219 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:00.248165 (+ 7946us) server_negotiation.cc:407] Connection header received
0811 16:50:00.248192 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:00.248193 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:00.248205 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:00.248259 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:00.248399 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.249108 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.250474 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.251033 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.251083 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:00.251092 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:00.251294 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 16:50:00.251333 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:50:00.251770 23109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:00.239995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:41701 (local address 127.2.55.131:58711)
0811 16:50:00.248059 (+ 8064us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:00.248071 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:00.248119 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:00.248278 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:00.248280 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:00.248282 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:00.248315 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:00.248316 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.249273 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.249273 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:00.250369 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:00.250371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.251150 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.251151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:00.251212 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:00.251215 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:50:00.251651 (+ 436us) client_negotiation.cc:240] Negotiation successful
0811 16:50:00.251701 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8052,"thread_start_us":97,"threads_started":1}
I20260811 16:50:00.252269 22491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2c580c98ecc4c08a985cced540a1f22" candidate_uuid: "147af255058e4767b84fd51ac3bd1239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2be13503ec6c4cdabaa5dab22427e942" is_pre_election: true
I20260811 16:50:00.252714 22830 leader_election.cc:302] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 147af255058e4767b84fd51ac3bd1239; no voters: 2be13503ec6c4cdabaa5dab22427e942, bea01ea1f33048df9182dbd1b55d44ad
I20260811 16:50:00.252866 23100 raft_consensus.cc:2726] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 16:50:00.285861 23082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:00.282460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58528 (local address 127.2.55.129:41701)
0811 16:50:00.282502 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:00.282504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:00.282511 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:50:00.282566 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:00.282567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:00.282589 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:00.282652 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:50:00.282835 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.283587 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.284736 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:00.285051 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:00.285113 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:00.285323 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:50:00.285459 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:50:00.285529 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:00.285756 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 16:50:00.285777 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:50:00.291193 22712 raft_consensus.cc:1261] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad [term 1 FOLLOWER]: Refusing update from remote peer 2be13503ec6c4cdabaa5dab22427e942: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:50:00.291181 22928 raft_consensus.cc:1261] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239 [term 1 FOLLOWER]: Refusing update from remote peer 2be13503ec6c4cdabaa5dab22427e942: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:50:00.291534 23114 consensus_queue.cc:1035] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "147af255058e4767b84fd51ac3bd1239" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 42627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:50:00.291654 23098 consensus_queue.cc:1035] T c2c580c98ecc4c08a985cced540a1f22 P 2be13503ec6c4cdabaa5dab22427e942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bea01ea1f33048df9182dbd1b55d44ad" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:50:00.296655 23117 mvcc.cc:205] Tried to move back new op lower bound from 7317368833188716544 to 7317368833006182400. Current Snapshot: MvccSnapshot[applied={T|T < 7317368833188716544}]
I20260811 16:50:00.297465 23120 mvcc.cc:205] Tried to move back new op lower bound from 7317368833188716544 to 7317368833006182400. Current Snapshot: MvccSnapshot[applied={T|T < 7317368833188716544}]
I20260811 16:50:00.300808 22215 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:50:00.300932 22215 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:50:00.301667 22215 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57bc7db2d8c94b54a231c3896d981861: Sending DeleteTablet for 3 replicas of tablet c2c580c98ecc4c08a985cced540a1f22
I20260811 16:50:00.302261 22891 tablet_service.cc:1514] Processing DeleteTablet for tablet c2c580c98ecc4c08a985cced540a1f22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:50:00 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:48176
I20260811 16:50:00.302521 22666 tablet_service.cc:1514] Processing DeleteTablet for tablet c2c580c98ecc4c08a985cced540a1f22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:50:00 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:46590
I20260811 16:50:00.302799 22457 tablet_service.cc:1514] Processing DeleteTablet for tablet c2c580c98ecc4c08a985cced540a1f22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:50:00 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:58512
I20260811 16:50:00.304849 23119 mvcc.cc:205] Tried to move back new op lower bound from 7317368833188716544 to 7317368833006182400. Current Snapshot: MvccSnapshot[applied={T|T < 7317368833188716544}]
I20260811 16:50:00.305106 23127 tablet_replica.cc:330] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239: stopping tablet replica
I20260811 16:50:00.305485 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 22289
I20260811 16:50:00.324715 23128 tablet_replica.cc:330] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad: stopping tablet replica
I20260811 16:50:00.325085 23128 raft_consensus.cc:2229] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:50:00.325300 23128 raft_consensus.cc:2258] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:50:00.305233 23127 raft_consensus.cc:2229] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:50:00.329095 23127 raft_consensus.cc:2258] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:50:00.330808 23128 ts_tablet_manager.cc:1905] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:50:00.331359 23127 ts_tablet_manager.cc:1905] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:50:00.333191 23127 ts_tablet_manager.cc:1918] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:50:00.333274 23127 log.cc:1196] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/c2c580c98ecc4c08a985cced540a1f22
I20260811 16:50:00.333549 23127 ts_tablet_manager.cc:1939] T c2c580c98ecc4c08a985cced540a1f22 P 147af255058e4767b84fd51ac3bd1239: Deleting consensus metadata
I20260811 16:50:00.334084 22191 catalog_manager.cc:4841] TS 147af255058e4767b84fd51ac3bd1239 (127.2.55.131:42627): tablet c2c580c98ecc4c08a985cced540a1f22 (table test-table [id=4986daf3ef6e486fbe41610a6f4ba228]) successfully deleted
I20260811 16:50:00.340379 23128 ts_tablet_manager.cc:1918] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:50:00.340477 23128 log.cc:1196] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/c2c580c98ecc4c08a985cced540a1f22
I20260811 16:50:00.340852 23128 ts_tablet_manager.cc:1939] T c2c580c98ecc4c08a985cced540a1f22 P bea01ea1f33048df9182dbd1b55d44ad: Deleting consensus metadata
I20260811 16:50:00.341403 22191 catalog_manager.cc:4841] TS bea01ea1f33048df9182dbd1b55d44ad (127.2.55.130:40917): tablet c2c580c98ecc4c08a985cced540a1f22 (table test-table [id=4986daf3ef6e486fbe41610a6f4ba228]) successfully deleted
W20260811 16:50:00.348043 22195 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.55.129:41701 (error 108)
I20260811 16:50:00.348959 23080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:00.348801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:41701 (local address 127.0.0.1:58544)
0811 16:50:00.348879 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:00.348917 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:41701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 16:50:00.349215 22195 catalog_manager.cc:4584] TS 2be13503ec6c4cdabaa5dab22427e942 (127.2.55.129:41701): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c2c580c98ecc4c08a985cced540a1f22: Network error: Client connection negotiation failed: client connection to 127.2.55.129:41701: connect: Connection refused (error 111)
I20260811 16:50:00.352990 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 22576
I20260811 16:50:00.372893 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 22792
I20260811 16:50:00.384155 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 22161
I20260811 16:50:00.402987 2270 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 16:50:00.750913 2270 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 16:50:00.751024 2270 mini_ranger.cc:66] Stopping Ranger...
I20260811 16:50:01.095937 2270 mini_ranger.cc:68] Stopped Ranger
2026-08-11 16:50:01.096 UTC [20552] LOG: received smart shutdown request
2026-08-11 16:50:01.101 UTC [20552] LOG: background worker "logical replication launcher" (PID 20569) exited with exit code 1
2026-08-11 16:50:01.101 UTC [20560] LOG: shutting down
2026-08-11 16:50:01.284 UTC [20552] LOG: database system is shut down
2026-08-11T16:50:01Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (51020 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:50:01 dist-test-slave-3h5h krb5kdc[23153](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:50:01 dist-test-slave-3h5h krb5kdc[23153](info): set up 2 sockets
Aug 11 16:50:01 dist-test-slave-3h5h krb5kdc[23153](info): commencing operation
krb5kdc: starting...
W20260811 16:50:02.701321 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:50:02 dist-test-slave-3h5h krb5kdc[23153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:50:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:50:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:50:02.832183 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:40085
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:40085,127.2.55.189:42215,127.2.55.188:36883
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:50:02.920053 23174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:02.920298 23174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:02.920336 23174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:02.921531 23174 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:50:02.921597 23174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:02.921633 23174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:02.921664 23174 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:50:02.921689 23174 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:50:02.923234 23174 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:40085,127.2.55.189:42215,127.2.55.188:36883
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:40085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:02.923517 23174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:02.923758 23174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:02.928995 23184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:02.928996 23190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:02.929025 23185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:02.929332 23174 server_base.cc:1034] running on GCE node
I20260811 16:50:02.929579 23174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:02.929837 23174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:02.931026 23174 hybrid_clock.cc:648] HybridClock initialized: now 1786467002931004 us; error 31 us; skew 500 ppm
Aug 11 16:50:02 dist-test-slave-3h5h krb5kdc[23153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467002, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:02.937747 23174 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:50:02.938211 23174 webserver.cc:460] Webserver started at http://127.2.55.190:33487/ using document root <none> and password file <none>
I20260811 16:50:02.938442 23174 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:02.938489 23174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:02.938599 23174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:50:02.939723 23174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "9765bbfe5a334c6bbd970926a8943559"
format_stamp: "Formatted at 2026-08-11 16:50:02 on dist-test-slave-3h5h"
server_key: "13b7e0d27cc71538f2a5d513f39086c0"
server_key_iv: "c6ac581d98182bc6c0347d628dc425bf"
server_key_version: "encryptionkey@0"
I20260811 16:50:02.940055 23174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "9765bbfe5a334c6bbd970926a8943559"
format_stamp: "Formatted at 2026-08-11 16:50:02 on dist-test-slave-3h5h"
server_key: "13b7e0d27cc71538f2a5d513f39086c0"
server_key_iv: "c6ac581d98182bc6c0347d628dc425bf"
server_key_version: "encryptionkey@0"
I20260811 16:50:02.941570 23174 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260811 16:50:02.942445 23201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:02.942641 23174 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:02.942762 23174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "9765bbfe5a334c6bbd970926a8943559"
format_stamp: "Formatted at 2026-08-11 16:50:02 on dist-test-slave-3h5h"
server_key: "13b7e0d27cc71538f2a5d513f39086c0"
server_key_iv: "c6ac581d98182bc6c0347d628dc425bf"
server_key_version: "encryptionkey@0"
I20260811 16:50:02.942848 23174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:02.953137 23174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:02.955506 23174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:02.955701 23174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:02.960184 23174 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:40085
I20260811 16:50:02.960237 23291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:40085 every 8 connection(s)
I20260811 16:50:02.960616 23174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:50:02.961642 23292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:02.963362 23292 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:50:02.968624 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 23174
I20260811 16:50:02.968770 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:50:02.969087 2270 external_mini_cluster.cc:1428] Setting key 399dcaf856ed3f12d88fff39d9baacea
Aug 11 16:50:02 dist-test-slave-3h5h krb5kdc[23153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467002, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:02.974663 23298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:02.964152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33774 (local address 127.2.55.190:40085)
0811 16:50:02.964350 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:02.964361 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:02.964497 (+ 136us) server_negotiation.cc:407] Connection header received
0811 16:50:02.965067 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:02.965069 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:02.965086 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:02.965175 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:02.965836 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:02.966807 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:02.967790 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:02.968131 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:02.968242 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:02.970772 (+ 2530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:02.970781 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:02.970782 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:02.970790 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:02.972659 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:02.973202 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:02.973206 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:02.973206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:02.973298 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:02.973603 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:02.973603 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:02.973604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:02.973908 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:02.973985 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:02.974286 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 16:50:02.974485 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":90,"server-negotiator.queue_time_us":159,"thread_start_us":120,"threads_started":1}
I20260811 16:50:02.974671 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:02.964137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:40085 (local address 127.0.0.1:33774)
0811 16:50:02.964318 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:02.964358 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:02.964890 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:02.965204 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:02.965206 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:02.965479 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:02.965711 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:02.965718 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:02.966910 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:02.966911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:02.967654 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:02.967657 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:02.968227 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:02.968228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:02.968293 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:02.968945 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:02.968958 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:02.970684 (+ 1726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:02.972757 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:02.972765 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:02.972767 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:02.973080 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:02.973383 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:02.973384 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:02.973385 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:02.973519 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:02.973989 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:02.973998 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:02.974088 (+ 90us) client_negotiation.cc:769] Sending connection context
0811 16:50:02.974199 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 16:50:02.974406 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":103,"threads_started":1}
I20260811 16:50:02.975591 23292 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:50:02.975981 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:02.975839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:42215 (local address 127.0.0.1:57282)
0811 16:50:02.975893 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:02.975948 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:42215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 16:50:02.976166 23209 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.55.189:42215: connect: Connection refused (error 111)
I20260811 16:50:02.976744 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:02.976631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:42215 (local address 127.0.0.1:57292)
0811 16:50:02.976686 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:02.976721 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:42215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 16:50:02.976959 23292 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.189:42215: Network error: Client connection negotiation failed: client connection to 127.2.55.189:42215: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.2.55.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.189.keytab.
Entry for principal kudu/127.2.55.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.189.keytab.
I20260811 16:50:03.000411 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.189:42215
--webserver_interface=127.2.55.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.189.keytab
--principal=kudu/127.2.55.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:40085,127.2.55.189:42215,127.2.55.188:36883
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:50:03.026314 23292 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } attempt: 1
I20260811 16:50:03.026842 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.026675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:42215 (local address 127.0.0.1:57302)
0811 16:50:03.026750 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.026801 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:42215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 16:50:03.027217 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.027122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:42215 (local address 127.0.0.1:57318)
0811 16:50:03.027169 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.027198 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:42215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 16:50:03.027328 23292 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.189:42215: Network error: Client connection negotiation failed: client connection to 127.2.55.189:42215: connect: Connection refused (error 111)
W20260811 16:50:03.093076 23302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:03.093501 23302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:03.093570 23302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 16:50:03.095566 23292 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } attempt: 2
W20260811 16:50:03.095806 23302 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:50:03.095863 23302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:03.095899 23302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:03.095927 23302 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:50:03.095944 23302 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:50:03.096148 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.095946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:42215 (local address 127.0.0.1:57332)
0811 16:50:03.096063 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.096109 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:42215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 16:50:03.096493 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.096394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:42215 (local address 127.0.0.1:57338)
0811 16:50:03.096432 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.096466 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:42215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260811 16:50:03.096598 23292 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.189:42215: Network error: Client connection negotiation failed: client connection to 127.2.55.189:42215: connect: Connection refused (error 111)
I20260811 16:50:03.098666 23302 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:40085,127.2.55.189:42215,127.2.55.188:36883
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.189.keytab
--principal=kudu/127.2.55.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.189:42215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.55.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:03.098985 23302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:03.099287 23302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:03.105639 23310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:03.105639 23309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:03.105756 23313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:03.106524 23302 server_base.cc:1034] running on GCE node
I20260811 16:50:03.106835 23302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:03.107306 23302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:03.108464 23302 hybrid_clock.cc:648] HybridClock initialized: now 1786467003108444 us; error 38 us; skew 500 ppm
Aug 11 16:50:03 dist-test-slave-3h5h krb5kdc[23153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467003, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:03.111820 23302 init.cc:377] Logged in from keytab as kudu/127.2.55.189@KRBTEST.COM (short username kudu)
I20260811 16:50:03.112412 23302 webserver.cc:460] Webserver started at http://127.2.55.189:35557/ using document root <none> and password file <none>
I20260811 16:50:03.112694 23302 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:03.112762 23302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:03.112942 23302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:50:03.114773 23302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/data/instance:
uuid: "90059edfc5524803a0895138beb54aae"
format_stamp: "Formatted at 2026-08-11 16:50:03 on dist-test-slave-3h5h"
server_key: "04089360e7e75d9cd5e1fd127f1c88e6"
server_key_iv: "9e596729d4636c3a10218993d7a8570c"
server_key_version: "encryptionkey@0"
I20260811 16:50:03.115334 23302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/wal/instance:
uuid: "90059edfc5524803a0895138beb54aae"
format_stamp: "Formatted at 2026-08-11 16:50:03 on dist-test-slave-3h5h"
server_key: "04089360e7e75d9cd5e1fd127f1c88e6"
server_key_iv: "9e596729d4636c3a10218993d7a8570c"
server_key_version: "encryptionkey@0"
I20260811 16:50:03.117012 23302 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260811 16:50:03.117997 23325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:03.118206 23302 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:03.118299 23302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/wal
uuid: "90059edfc5524803a0895138beb54aae"
format_stamp: "Formatted at 2026-08-11 16:50:03 on dist-test-slave-3h5h"
server_key: "04089360e7e75d9cd5e1fd127f1c88e6"
server_key_iv: "9e596729d4636c3a10218993d7a8570c"
server_key_version: "encryptionkey@0"
I20260811 16:50:03.118376 23302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:03.146234 23302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:03.148820 23302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:03.149003 23302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:03.153038 23302 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.189:42215
I20260811 16:50:03.153090 23415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.189:42215 every 8 connection(s)
I20260811 16:50:03.153450 23302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/data/info.pb
I20260811 16:50:03.154414 23416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:03.156070 23416 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:50:03.157167 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 23302
I20260811 16:50:03.157286 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-1/wal/instance
I20260811 16:50:03.157474 2270 external_mini_cluster.cc:1428] Setting key 2e22b94acdcd77b6ffcbd7385536a2cc
Aug 11 16:50:03 dist-test-slave-3h5h krb5kdc[23153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467003, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.189@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.55.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.188@KRBTEST.COM" created.
I20260811 16:50:03.173347 23298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.156871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33780 (local address 127.2.55.190:40085)
0811 16:50:03.157018 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:03.157021 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:03.157143 (+ 122us) server_negotiation.cc:407] Connection header received
0811 16:50:03.157717 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:03.157719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:03.157738 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:03.157816 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:03.158447 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.159204 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.160825 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.161198 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.161281 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.163522 (+ 2241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:03.163525 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:03.163525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:03.163534 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:03.171224 (+ 7690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.171933 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.171935 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.171936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.172022 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.172385 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.172386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.172387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.172626 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:03.172717 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:03.173093 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 16:50:03.173216 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:50:03.173377 23418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.156803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:40085 (local address 127.0.0.1:33780)
0811 16:50:03.156990 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.157034 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:03.157607 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:03.157886 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:03.157889 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:03.158150 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:03.158347 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:03.158351 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.159321 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.159322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:03.160696 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:03.160699 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.161297 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.161298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:03.161411 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.161982 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:03.161991 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:03.163423 (+ 1432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:03.171370 (+ 7947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:03.171384 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:03.171388 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:03.171817 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:03.172151 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:03.172151 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:03.172152 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:03.172301 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:03.172709 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:03.172715 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:03.172936 (+ 221us) client_negotiation.cc:769] Sending connection context
0811 16:50:03.173038 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 16:50:03.173193 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":105,"threads_started":1}
I20260811 16:50:03.174080 23416 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:50:03 dist-test-slave-3h5h krb5kdc[23153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467003, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.189@KRBTEST.COM for kudu/127.2.55.189@KRBTEST.COM
I20260811 16:50:03.181948 23418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.174388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:42215 (local address 127.0.0.1:57346)
0811 16:50:03.174441 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.174454 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:03.174504 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:03.174874 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:03.174875 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:03.175023 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:03.175078 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:03.175080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.175963 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.175964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:03.176464 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:03.176466 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.176999 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.177000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:03.177070 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.177522 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:03.177528 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:03.178755 (+ 1227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:03.180593 (+ 1838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:03.180594 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:03.180594 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:03.180902 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:03.181221 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:03.181222 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:03.181222 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:03.181281 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:03.181590 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:03.181590 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:03.181636 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 16:50:03.181700 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:50:03.181820 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 16:50:03.181982 23425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.174485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57346 (local address 127.2.55.189:42215)
0811 16:50:03.174701 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:03.174705 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:03.174725 (+ 20us) server_negotiation.cc:407] Connection header received
0811 16:50:03.174745 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:03.174747 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:03.174760 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:03.174860 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:03.175176 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.175863 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.176550 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.176913 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.177001 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.178858 (+ 1857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:03.178868 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:03.178869 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:03.178876 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:03.180487 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.181009 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.181013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.181013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.181106 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.181352 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.181353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.181353 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.181517 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:03.181636 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:03.181742 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 16:50:03.181877 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":179,"thread_start_us":119,"threads_started":1}
I20260811 16:50:03.182812 23416 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:50:03.183343 23418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.183161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:36883 (local address 127.0.0.1:39548)
0811 16:50:03.183225 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.183305 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 16:50:03.183527 23331 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
I20260811 16:50:03.184098 23418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.183904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:36883 (local address 127.0.0.1:39556)
0811 16:50:03.184025 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.184065 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
W20260811 16:50:03.184255 23416 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.188:36883: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
I20260811 16:50:03.187775 23292 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } attempt: 3
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.188.keytab.
Entry for principal kudu/127.2.55.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.188.keytab.
I20260811 16:50:03.192039 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.188:36883
--webserver_interface=127.2.55.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.188.keytab
--principal=kudu/127.2.55.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:40085,127.2.55.189:42215,127.2.55.188:36883
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 16:50:03 dist-test-slave-3h5h krb5kdc[23153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467002, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for kudu/127.2.55.189@KRBTEST.COM
I20260811 16:50:03.197172 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.188319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:42215 (local address 127.0.0.1:57360)
0811 16:50:03.188366 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.188378 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:03.188430 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:03.188568 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:03.188569 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:03.188810 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:03.188995 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:03.189000 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.189793 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.189794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:03.190537 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:03.190541 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.191269 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.191271 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:03.191359 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.191804 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:03.191812 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:03.193493 (+ 1681us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:03.195808 (+ 2315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:03.195810 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:03.195811 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:03.196063 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:03.196327 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:03.196328 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:03.196329 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:03.196407 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:03.196664 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:03.196666 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:03.196731 (+ 65us) client_negotiation.cc:769] Sending connection context
0811 16:50:03.196821 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 16:50:03.197007 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 16:50:03.197357 23425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.188361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57360 (local address 127.2.55.189:42215)
0811 16:50:03.188409 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:03.188411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:03.188422 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:50:03.188502 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:03.188503 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:03.188515 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:03.188565 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:03.189164 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.189699 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.190659 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.191148 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.191265 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.193621 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:03.193623 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:03.193623 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:03.193631 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:03.195707 (+ 2076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.196169 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.196170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.196170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.196244 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.196474 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.196475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.196476 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.196595 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:03.196650 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:03.197102 (+ 452us) server_negotiation.cc:299] Negotiation successful
0811 16:50:03.197234 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:50:03.197782 23292 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:50:03.198204 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.198070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:36883 (local address 127.0.0.1:39566)
0811 16:50:03.198122 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.198164 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 16:50:03.198684 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.198565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:36883 (local address 127.0.0.1:39572)
0811 16:50:03.198619 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.198654 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 16:50:03.198799 23292 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.188:36883: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
I20260811 16:50:03.229979 23292 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } attempt: 1
I20260811 16:50:03.230510 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.230348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:36883 (local address 127.0.0.1:39580)
0811 16:50:03.230423 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.230473 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 16:50:03.230911 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.230808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:36883 (local address 127.0.0.1:39592)
0811 16:50:03.230859 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.230889 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 16:50:03.231118 23292 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.188:36883: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
I20260811 16:50:03.233525 23416 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } attempt: 1
I20260811 16:50:03.234089 23418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.233855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:36883 (local address 127.0.0.1:39598)
0811 16:50:03.233991 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.234042 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 16:50:03.234596 23418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.234465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:36883 (local address 127.0.0.1:39600)
0811 16:50:03.234523 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.234558 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 16:50:03.234719 23416 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.188:36883: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
W20260811 16:50:03.284662 23432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:03.285048 23432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:03.285084 23432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:03.286443 23432 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:50:03.286501 23432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:03.286520 23432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:03.286536 23432 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:50:03.286552 23432 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:50:03.288381 23432 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:40085,127.2.55.189:42215,127.2.55.188:36883
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.188.keytab
--principal=kudu/127.2.55.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.188:36883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.55.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:03.288689 23432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:03.289019 23432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:03.294767 23440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:03.294859 23442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:03.294910 23439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:03.295854 23432 server_base.cc:1034] running on GCE node
I20260811 16:50:03.296164 23432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:03.296548 23432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:03.297734 23432 hybrid_clock.cc:648] HybridClock initialized: now 1786467003297695 us; error 53 us; skew 500 ppm
Aug 11 16:50:03 dist-test-slave-3h5h krb5kdc[23153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467003, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:03.301457 23432 init.cc:377] Logged in from keytab as kudu/127.2.55.188@KRBTEST.COM (short username kudu)
I20260811 16:50:03.302081 23432 webserver.cc:460] Webserver started at http://127.2.55.188:43961/ using document root <none> and password file <none>
I20260811 16:50:03.302356 23432 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:03.302421 23432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:03.302560 23432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:50:03.302881 23416 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } attempt: 2
I20260811 16:50:03.303292 23418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.303160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:36883 (local address 127.0.0.1:39610)
0811 16:50:03.303221 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.303258 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 16:50:03.303601 23418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.303540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:36883 (local address 127.0.0.1:39614)
0811 16:50:03.303563 (+ 23us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.303585 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260811 16:50:03.303718 23416 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.188:36883: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
I20260811 16:50:03.304020 23432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/data/instance:
uuid: "af8954c8875c46b989e18e56c5fed6a3"
format_stamp: "Formatted at 2026-08-11 16:50:03 on dist-test-slave-3h5h"
server_key: "39f16e940134ec85b9cf1ceb498b1872"
server_key_iv: "bdd05f6f1e0919baa8005ccf9ae13cbe"
server_key_version: "encryptionkey@0"
I20260811 16:50:03.304394 23432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/wal/instance:
uuid: "af8954c8875c46b989e18e56c5fed6a3"
format_stamp: "Formatted at 2026-08-11 16:50:03 on dist-test-slave-3h5h"
server_key: "39f16e940134ec85b9cf1ceb498b1872"
server_key_iv: "bdd05f6f1e0919baa8005ccf9ae13cbe"
server_key_version: "encryptionkey@0"
I20260811 16:50:03.305855 23432 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 16:50:03.306262 23292 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } attempt: 2
I20260811 16:50:03.306704 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.306544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:36883 (local address 127.0.0.1:39616)
0811 16:50:03.306602 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.306670 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 16:50:03.306707 23456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:03.306892 23432 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:50:03.306981 23432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/wal
uuid: "af8954c8875c46b989e18e56c5fed6a3"
format_stamp: "Formatted at 2026-08-11 16:50:03 on dist-test-slave-3h5h"
server_key: "39f16e940134ec85b9cf1ceb498b1872"
server_key_iv: "bdd05f6f1e0919baa8005ccf9ae13cbe"
server_key_version: "encryptionkey@0"
I20260811 16:50:03.307082 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.306989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:36883 (local address 127.0.0.1:39622)
0811 16:50:03.307027 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.307058 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 16:50:03.307058 23432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260811 16:50:03.307175 23292 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.188:36883: Network error: Client connection negotiation failed: client connection to 127.2.55.188:36883: connect: Connection refused (error 111)
I20260811 16:50:03.324636 23432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:03.326781 23432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:03.326900 23432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:03.331208 23432 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.188:36883
I20260811 16:50:03.331245 23541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.188:36883 every 8 connection(s)
I20260811 16:50:03.331609 23432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/data/info.pb
I20260811 16:50:03.332654 23542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:03.334556 23542 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:50:03.339689 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 23432
I20260811 16:50:03.339773 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466835675343-2270-0/minicluster-data/master-2/wal/instance
I20260811 16:50:03.339988 2270 external_mini_cluster.cc:1428] Setting key 13db44be2b1ec6af93e536c163a13258
Aug 11 16:50:03 dist-test-slave-3h5h krb5kdc[23153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467003, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.188@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:03.345036 23298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.335433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33790 (local address 127.2.55.190:40085)
0811 16:50:03.335537 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:03.335540 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:03.335674 (+ 134us) server_negotiation.cc:407] Connection header received
0811 16:50:03.336212 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:03.336213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:03.336224 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:03.336289 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:03.337029 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.338056 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.339047 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.339231 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.339285 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.341977 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:03.341979 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:03.341979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:03.341987 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:03.343562 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.343992 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.343994 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.343994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.344055 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.344328 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.344329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.344329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.344451 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:03.344522 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:03.344827 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 16:50:03.344945 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 16:50:03.345204 23545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.335346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:40085 (local address 127.0.0.1:33790)
0811 16:50:03.335531 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.335572 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:03.336097 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:03.336405 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:03.336408 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:03.336667 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:03.336941 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:03.336946 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.338151 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.338152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:03.338967 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:03.338970 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.339308 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.339308 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:03.339414 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.340082 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:03.340094 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:03.341883 (+ 1789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:03.343667 (+ 1784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:03.343675 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:03.343677 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:03.343908 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:03.344134 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:03.344135 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:03.344136 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:03.344252 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:03.344526 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:03.344533 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:03.344673 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 16:50:03.344776 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 16:50:03.344960 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":73,"threads_started":1}
Aug 11 16:50:03 dist-test-slave-3h5h krb5kdc[23153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.188@KRBTEST.COM
I20260811 16:50:03.345844 23542 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:50:03.349987 23547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.340404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39632 (local address 127.2.55.188:36883)
0811 16:50:03.340580 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:03.340585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:03.340609 (+ 24us) server_negotiation.cc:407] Connection header received
0811 16:50:03.340711 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:03.340717 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:03.340741 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:03.340850 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:03.341606 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.342398 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.343525 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.343819 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.343931 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.346534 (+ 2603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:03.346543 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:03.346543 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:03.346549 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:03.348322 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.348913 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.348916 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.348916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.348992 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.349278 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.349279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.349279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.349485 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:03.349656 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:03.349759 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 16:50:03.349842 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":80,"threads_started":1}
Aug 11 16:50:03 dist-test-slave-3h5h krb5kdc[23153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467003, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.188@KRBTEST.COM for kudu/127.2.55.189@KRBTEST.COM
I20260811 16:50:03.353848 23545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.346190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:42215 (local address 127.0.0.1:57364)
0811 16:50:03.346227 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.346240 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:03.346285 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:03.346461 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:03.346462 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:03.346630 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:03.346687 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:03.346689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.347507 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.347507 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:03.348322 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:03.348324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.348905 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.348906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:03.349011 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.349440 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:03.349445 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:03.350889 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:03.352764 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:03.352766 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:03.352766 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:03.353036 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:03.353248 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:03.353249 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:03.353249 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:03.353318 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:03.353568 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:03.353569 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:03.353613 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 16:50:03.353687 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 16:50:03.353784 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 16:50:03.353907 23425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.346267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57364 (local address 127.2.55.189:42215)
0811 16:50:03.346343 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:03.346345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:03.346355 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:50:03.346383 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:03.346385 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:03.346396 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:03.346459 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:03.346769 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.347420 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.348443 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.348796 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.348902 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.350981 (+ 2079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:03.350983 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:03.350983 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:03.350991 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:03.352662 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.353112 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.353113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.353113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.353176 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.353383 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.353384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.353384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.353495 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:03.353546 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:03.353736 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 16:50:03.353816 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 16:50:03.354199 23542 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:50:03 dist-test-slave-3h5h krb5kdc[23153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
Aug 11 16:50:03 dist-test-slave-3h5h krb5kdc[23153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467003, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.188@KRBTEST.COM for kudu/127.2.55.188@KRBTEST.COM
I20260811 16:50:03.359398 23298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.351005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33806 (local address 127.2.55.190:40085)
0811 16:50:03.351056 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:03.351058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:03.351066 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:50:03.351137 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:03.351138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:03.351149 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:03.351212 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:03.351911 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.352670 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.353715 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.353995 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.354069 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.356534 (+ 2465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:03.356536 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:03.356536 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:03.356548 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:03.358193 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.358574 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.358576 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.358576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.358642 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.358849 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.358850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.358850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.358966 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:03.359176 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:03.359216 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 16:50:03.359298 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:50:03.361991 23547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.354579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39638 (local address 127.2.55.188:36883)
0811 16:50:03.354613 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:03.354621 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:03.354661 (+ 40us) server_negotiation.cc:407] Connection header received
0811 16:50:03.354729 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:03.354730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:03.354738 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:03.354783 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:03.355055 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.355544 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.356239 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.356579 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.356635 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.358654 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:03.358656 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:03.358656 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:03.358663 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:03.360325 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.361223 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.361224 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.361225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.361276 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.361473 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.361473 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.361473 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.361567 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:03.361652 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:03.361785 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 16:50:03.361902 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":16}
I20260811 16:50:03.361991 23545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.354536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:36883 (local address 127.0.0.1:39638)
0811 16:50:03.354616 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.354625 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:03.354675 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:03.354787 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:03.354788 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:03.354936 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:03.354981 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:03.354983 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.355627 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.355627 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:03.356144 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:03.356147 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.356673 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.356674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:03.356746 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.357269 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:03.357275 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:03.358569 (+ 1294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:03.360931 (+ 2362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:03.360932 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:03.360932 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:03.361146 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:03.361347 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:03.361347 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:03.361348 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:03.361412 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:03.361637 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:03.361638 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:03.361687 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 16:50:03.361758 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 16:50:03.361856 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 16:50:03.363569 23542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3: Bootstrap starting.
I20260811 16:50:03.364602 23542 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3: Neither blocks nor log segments found. Creating new log.
Aug 11 16:50:03 dist-test-slave-3h5h krb5kdc[23153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467002, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.189@KRBTEST.COM
I20260811 16:50:03.364995 23542 log.cc:824] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:03.365779 23542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3: No bootstrap required, opened a new log
I20260811 16:50:03.367395 23542 raft_consensus.cc:348] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } }
I20260811 16:50:03.367547 23542 raft_consensus.cc:374] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:03.367622 23542 raft_consensus.cc:729] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af8954c8875c46b989e18e56c5fed6a3, State: Initialized, Role: FOLLOWER
I20260811 16:50:03.367764 23542 consensus_queue.cc:260] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } }
I20260811 16:50:03.368165 23542 sys_catalog.cc:564] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:50:03.368253 23425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.360237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57368 (local address 127.2.55.189:42215)
0811 16:50:03.360286 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:03.360288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:03.360297 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:50:03.360319 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:03.360320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:03.360329 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:03.360403 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:03.360877 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.361614 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.362576 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.362757 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.362852 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.365278 (+ 2426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:03.365280 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:03.365281 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:03.365288 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:03.366876 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.367220 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.367221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.367222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.367281 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.367499 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.367500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.367501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.367652 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:03.367828 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:03.368054 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 16:50:03.368148 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:50:03.368422 23550 sys_catalog.cc:455] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } } }
I20260811 16:50:03.368515 23550 sys_catalog.cc:458] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:50:03.370326 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 16:50:03.370428 23569 catalog_manager.cc:1558] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:50:03.370468 23569 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:50:03.370652 23432 master_runner.cc:186] Error getting master registration for 127.2.55.190:40085: OK, instance_id { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" instance_seqno: 1786467002959019 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:50:03.373232 23432 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:50:03.380036 23298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.372050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33814 (local address 127.2.55.190:40085)
0811 16:50:03.372099 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:03.372101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:03.372110 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:50:03.372162 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:03.372163 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:03.372175 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:03.372210 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:03.373095 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.373843 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.374633 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.374948 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.375028 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.376370 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:03.376372 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:03.376372 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:03.376381 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:03.378519 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.378922 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.378923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.378924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.379000 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.379202 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.379203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.379203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.379333 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:03.379429 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:03.379818 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 16:50:03.379917 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:50:03.386097 23425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.372507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57380 (local address 127.2.55.189:42215)
0811 16:50:03.372544 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:03.372545 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:03.377397 (+ 4852us) server_negotiation.cc:407] Connection header received
0811 16:50:03.377488 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:03.377490 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:03.377502 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:03.377559 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:03.378253 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.378986 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.380130 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.380425 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.380471 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.382186 (+ 1715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:03.382188 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:03.382188 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:03.382196 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:03.384387 (+ 2191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.384913 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.384915 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.384915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.384989 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.385330 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.385331 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.385332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.385517 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:03.385615 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:03.385876 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 16:50:03.385970 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:50:03.386103 23547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.372268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39650 (local address 127.2.55.188:36883)
0811 16:50:03.372326 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:03.372328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:03.377192 (+ 4864us) server_negotiation.cc:407] Connection header received
0811 16:50:03.377282 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:03.377283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:03.377297 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:03.377719 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:03.378501 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.379288 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.380397 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.380707 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.380754 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.382111 (+ 1357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:03.382113 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:03.382113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:03.382122 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:03.384358 (+ 2236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.385179 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.385180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.385180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.385241 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.385471 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.385472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.385472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.385664 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:03.385771 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:03.385919 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 16:50:03.386007 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:50:03.394869 23416 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } attempt: 3
Aug 11 16:50:03 dist-test-slave-3h5h krb5kdc[23153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467003, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.189@KRBTEST.COM for kudu/127.2.55.188@KRBTEST.COM
I20260811 16:50:03.402558 23418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.395225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:36883 (local address 127.0.0.1:39664)
0811 16:50:03.395289 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.395301 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:03.395352 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:03.395522 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:03.395523 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:03.395723 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:03.395788 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:03.395791 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.396620 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.396621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:03.397205 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:03.397208 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.397587 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.397588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:03.397652 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.398197 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:03.398203 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:03.399699 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:03.401574 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:03.401575 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:03.401575 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:03.401745 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:03.401950 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:03.401950 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:03.401951 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:03.402007 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:03.402316 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:03.402317 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:03.402356 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 16:50:03.402407 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 16:50:03.402485 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 16:50:03.402626 23547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.395298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39664 (local address 127.2.55.188:36883)
0811 16:50:03.395362 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:03.395364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:03.395377 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:50:03.395403 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:03.395404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:03.395414 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:03.395508 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:03.395884 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.396532 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.397298 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.397510 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.397591 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.399918 (+ 2327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:03.399919 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:03.399920 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:03.399927 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:03.401487 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.401817 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.401819 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.401819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.401883 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.402071 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.402072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.402072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.402226 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:03.402312 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:03.402444 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 16:50:03.402520 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:50:03.404479 23416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae: Bootstrap starting.
I20260811 16:50:03.405373 23416 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:03.405706 23416 log.cc:824] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:03.406320 23292 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } attempt: 3
I20260811 16:50:03.406643 23416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae: No bootstrap required, opened a new log
I20260811 16:50:03.408870 23416 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } }
I20260811 16:50:03.409019 23416 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:03.409053 23416 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90059edfc5524803a0895138beb54aae, State: Initialized, Role: FOLLOWER
I20260811 16:50:03.409195 23416 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } }
I20260811 16:50:03.409504 23416 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [sys.catalog]: configured and running, proceeding with master startup.
W20260811 16:50:03.411459 23609 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:50:03.411512 23609 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:50:03.411813 23589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } } }
I20260811 16:50:03.411880 23589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [sys.catalog]: This master's current role is: FOLLOWER
Aug 11 16:50:03 dist-test-slave-3h5h krb5kdc[23153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467002, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for kudu/127.2.55.188@KRBTEST.COM
I20260811 16:50:03.411931 23302 master_runner.cc:186] Error getting master registration for 127.2.55.190:40085: OK, instance_id { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" instance_seqno: 1786467002959019 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:50:03.415591 23302 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:50:03.416270 23547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.406745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39666 (local address 127.2.55.188:36883)
0811 16:50:03.407048 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:03.407050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:03.407062 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:50:03.407090 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:03.407091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:03.407112 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:03.407176 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:03.407534 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.408240 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.409421 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.409761 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.410155 (+ 394us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.412454 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:03.412456 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:03.412456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:03.412463 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:03.414618 (+ 2155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.415129 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.415130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.415131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.415203 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:03.415481 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:03.415482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:03.415482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:03.415759 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:03.415870 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:03.416073 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 16:50:03.416164 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191}
I20260811 16:50:03.416276 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:03.406705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:36883 (local address 127.0.0.1:39666)
0811 16:50:03.406774 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:03.406787 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:03.406838 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:03.407201 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:03.407202 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:03.407378 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:03.407428 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:03.407430 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.408384 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.408386 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:03.409301 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:03.409304 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:03.409871 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:03.409872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:03.409940 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:03.410506 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:03.410513 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:03.412351 (+ 1838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:03.414748 (+ 2397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:03.414749 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:03.414749 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:03.415007 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:03.415299 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:03.415300 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:03.415300 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:03.415376 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:03.415862 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:03.415864 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:03.415929 (+ 65us) client_negotiation.cc:769] Sending connection context
0811 16:50:03.416043 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 16:50:03.416164 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 16:50:03.418223 23292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559: Bootstrap starting.
I20260811 16:50:03.418926 23292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:03.419335 23292 log.cc:824] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:03.420538 23292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559: No bootstrap required, opened a new log
I20260811 16:50:03.422538 23292 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } }
I20260811 16:50:03.422703 23292 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:03.422762 23292 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9765bbfe5a334c6bbd970926a8943559, State: Initialized, Role: FOLLOWER
I20260811 16:50:03.422915 23292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } }
I20260811 16:50:03.423293 23292 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:50:03.423249 23613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } } }
I20260811 16:50:03.423498 23613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 16:50:03.426214 23633 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:50:03.426352 23633 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:50:03.428939 23174 master_runner.cc:263] No leader master found from master 9765bbfe5a334c6bbd970926a8943559
I20260811 16:50:03.428999 23174 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:50:03.431331 23589 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:50:03.431442 23589 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } }
I20260811 16:50:03.431730 23589 leader_election.cc:288] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9765bbfe5a334c6bbd970926a8943559 (127.2.55.190:40085), af8954c8875c46b989e18e56c5fed6a3 (127.2.55.188:36883)
I20260811 16:50:03.432036 23503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "90059edfc5524803a0895138beb54aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8954c8875c46b989e18e56c5fed6a3" is_pre_election: true
I20260811 16:50:03.432229 23503 raft_consensus.cc:2454] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90059edfc5524803a0895138beb54aae in term 0.
I20260811 16:50:03.432194 23250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "90059edfc5524803a0895138beb54aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9765bbfe5a334c6bbd970926a8943559" is_pre_election: true
I20260811 16:50:03.432312 23250 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90059edfc5524803a0895138beb54aae in term 0.
I20260811 16:50:03.432431 23331 leader_election.cc:302] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90059edfc5524803a0895138beb54aae, af8954c8875c46b989e18e56c5fed6a3; no voters:
I20260811 16:50:03.432581 23589 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:50:03.432636 23589 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:50:03.432669 23589 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:03.433825 23589 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } }
I20260811 16:50:03.433987 23589 leader_election.cc:288] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [CANDIDATE]: Term 1 election: Requested vote from peers 9765bbfe5a334c6bbd970926a8943559 (127.2.55.190:40085), af8954c8875c46b989e18e56c5fed6a3 (127.2.55.188:36883)
I20260811 16:50:03.434165 23250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "90059edfc5524803a0895138beb54aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9765bbfe5a334c6bbd970926a8943559"
I20260811 16:50:03.434185 23503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "90059edfc5524803a0895138beb54aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8954c8875c46b989e18e56c5fed6a3"
I20260811 16:50:03.434242 23250 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:03.434258 23503 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:03.435336 23250 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90059edfc5524803a0895138beb54aae in term 1.
I20260811 16:50:03.435671 23330 leader_election.cc:302] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90059edfc5524803a0895138beb54aae, 9765bbfe5a334c6bbd970926a8943559; no voters:
I20260811 16:50:03.435806 23503 raft_consensus.cc:2454] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90059edfc5524803a0895138beb54aae in term 1.
I20260811 16:50:03.435833 23589 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:50:03.436190 23589 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [term 1 LEADER]: Becoming Leader. State: Replica: 90059edfc5524803a0895138beb54aae, State: Running, Role: LEADER
I20260811 16:50:03.436300 23589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } }
I20260811 16:50:03.436812 23637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90059edfc5524803a0895138beb54aae. Latest consensus state: current_term: 1 leader_uuid: "90059edfc5524803a0895138beb54aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } } }
I20260811 16:50:03.436949 23637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [sys.catalog]: This master's current role is: LEADER
I20260811 16:50:03.445832 23641 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:50:03.446120 23641 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:50:03.447991 23503 raft_consensus.cc:1261] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3 [term 1 FOLLOWER]: Refusing update from remote peer 90059edfc5524803a0895138beb54aae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:50:03.448369 23637 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:50:03.450049 23550 sys_catalog.cc:455] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90059edfc5524803a0895138beb54aae. Latest consensus state: current_term: 1 leader_uuid: "90059edfc5524803a0895138beb54aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } } }
I20260811 16:50:03.450160 23550 sys_catalog.cc:458] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:50:03.450601 23250 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559 [term 1 FOLLOWER]: Refusing update from remote peer 90059edfc5524803a0895138beb54aae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:50:03.451546 23637 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:50:03.452883 23613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90059edfc5524803a0895138beb54aae. Latest consensus state: current_term: 1 leader_uuid: "90059edfc5524803a0895138beb54aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } } }
I20260811 16:50:03.452988 23613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:50:03.453958 23637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "90059edfc5524803a0895138beb54aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } } }
I20260811 16:50:03.454056 23637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [sys.catalog]: This master's current role is: LEADER
I20260811 16:50:03.454471 23550 sys_catalog.cc:455] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "90059edfc5524803a0895138beb54aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } } }
I20260811 16:50:03.454577 23550 sys_catalog.cc:458] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:50:03.454809 23642 mvcc.cc:205] Tried to move back new op lower bound from 7317368846120079360 to 7317368846075617280. Current Snapshot: MvccSnapshot[applied={T|T < 7317368846120079360}]
I20260811 16:50:03.455346 23643 mvcc.cc:205] Tried to move back new op lower bound from 7317368846120079360 to 7317368846075617280. Current Snapshot: MvccSnapshot[applied={T|T < 7317368846120079360}]
I20260811 16:50:03.456398 23589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "90059edfc5524803a0895138beb54aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } } }
I20260811 16:50:03.456491 23589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae [sys.catalog]: This master's current role is: LEADER
W20260811 16:50:03.456522 23211 tablet.cc:2369] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:50:03.456949 23613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "90059edfc5524803a0895138beb54aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9765bbfe5a334c6bbd970926a8943559" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40085 } } peers { permanent_uuid: "90059edfc5524803a0895138beb54aae" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 42215 } } peers { permanent_uuid: "af8954c8875c46b989e18e56c5fed6a3" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 36883 } } }
I20260811 16:50:03.457059 23613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:50:03.457156 23648 mvcc.cc:205] Tried to move back new op lower bound from 7317368846120079360 to 7317368846075617280. Current Snapshot: MvccSnapshot[applied={T|T < 7317368846120079360}]
I20260811 16:50:03.457290 23641 catalog_manager.cc:1347] Generated new cluster ID: 038fab2f71a34142ae6b1c8571c87f5a
I20260811 16:50:03.457352 23641 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:50:03.472328 23641 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:50:03.473150 23641 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:50:03.483698 23641 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90059edfc5524803a0895138beb54aae: Generated new TSK 0
I20260811 16:50:03.483935 23641 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:50:04.370950 23569 catalog_manager.cc:1259] Loaded cluster ID: 038fab2f71a34142ae6b1c8571c87f5a
I20260811 16:50:04.371025 23569 catalog_manager.cc:1552] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3: loading cluster ID for follower catalog manager: success
I20260811 16:50:04.371961 23569 catalog_manager.cc:1574] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3: acquiring CA information for follower catalog manager: success
I20260811 16:50:04.372288 23569 catalog_manager.cc:1602] T 00000000000000000000000000000000 P af8954c8875c46b989e18e56c5fed6a3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:50:04.426888 23633 catalog_manager.cc:1259] Loaded cluster ID: 038fab2f71a34142ae6b1c8571c87f5a
I20260811 16:50:04.426983 23633 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559: loading cluster ID for follower catalog manager: success
I20260811 16:50:04.427899 23633 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559: acquiring CA information for follower catalog manager: success
I20260811 16:50:04.428294 23633 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9765bbfe5a334c6bbd970926a8943559: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:50:04.543074 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 23174
I20260811 16:50:04.555358 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 23302
I20260811 16:50:04.569258 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 23432
2026-08-11T16:50:04Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3168 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:50:04 dist-test-slave-3h5h krb5kdc[23668](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:50:04 dist-test-slave-3h5h krb5kdc[23668](info): set up 2 sockets
Aug 11 16:50:04 dist-test-slave-3h5h krb5kdc[23668](info): commencing operation
krb5kdc: starting...
W20260811 16:50:05.861630 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.269s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:50:05 dist-test-slave-3h5h krb5kdc[23668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:50:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:50:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:50:06.000217 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:36645
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:42533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:36645
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:50:06.085263 23690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:06.085527 23690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:06.085568 23690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:06.086730 23690 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:50:06.086805 23690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:06.086830 23690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:06.086858 23690 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:50:06.086890 23690 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:50:06.088826 23690 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:42533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:36645
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:36645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:06.089279 23690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:06.089573 23690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:50:06.095038 23690 server_base.cc:1034] running on GCE node
W20260811 16:50:06.095021 23697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:06.095084 23696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:06.095012 23704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:06.095557 23690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:06.095868 23690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:06.097040 23690 hybrid_clock.cc:648] HybridClock initialized: now 1786467006097041 us; error 46 us; skew 500 ppm
Aug 11 16:50:06 dist-test-slave-3h5h krb5kdc[23668](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467006, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:06.099812 23690 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:50:06.100422 23690 webserver.cc:460] Webserver started at http://127.2.55.190:34851/ using document root <none> and password file <none>
I20260811 16:50:06.100664 23690 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:06.100733 23690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:06.100919 23690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:50:06.102041 23690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "514ba091c2a44e218df1ee7f45d5fe3b"
format_stamp: "Formatted at 2026-08-11 16:50:06 on dist-test-slave-3h5h"
server_key: "13159081e6a8236900836b928508e6a1"
server_key_iv: "24761e8696b4d027c67991b6313d5717"
server_key_version: "encryptionkey@0"
I20260811 16:50:06.102427 23690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "514ba091c2a44e218df1ee7f45d5fe3b"
format_stamp: "Formatted at 2026-08-11 16:50:06 on dist-test-slave-3h5h"
server_key: "13159081e6a8236900836b928508e6a1"
server_key_iv: "24761e8696b4d027c67991b6313d5717"
server_key_version: "encryptionkey@0"
I20260811 16:50:06.103894 23690 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:50:06.104916 23712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:06.105170 23690 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:06.105290 23690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "514ba091c2a44e218df1ee7f45d5fe3b"
format_stamp: "Formatted at 2026-08-11 16:50:06 on dist-test-slave-3h5h"
server_key: "13159081e6a8236900836b928508e6a1"
server_key_iv: "24761e8696b4d027c67991b6313d5717"
server_key_version: "encryptionkey@0"
I20260811 16:50:06.105373 23690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:06.122651 23690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:06.125332 23690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:06.125517 23690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:06.130196 23690 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:36645
I20260811 16:50:06.130254 23803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:36645 every 8 connection(s)
I20260811 16:50:06.130656 23690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:50:06.131572 23806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:06.134037 23806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b: Bootstrap starting.
I20260811 16:50:06.134673 23806 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:06.134979 23806 log.cc:824] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:06.135812 23806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b: No bootstrap required, opened a new log
I20260811 16:50:06.136445 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 23690
I20260811 16:50:06.136569 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:50:06.136775 2270 external_mini_cluster.cc:1428] Setting key 393fbaabcc8209432aa941b8af22cc8b
I20260811 16:50:06.138118 23806 raft_consensus.cc:348] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "514ba091c2a44e218df1ee7f45d5fe3b" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 36645 } }
I20260811 16:50:06.138374 23806 raft_consensus.cc:374] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:06.138455 23806 raft_consensus.cc:729] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514ba091c2a44e218df1ee7f45d5fe3b, State: Initialized, Role: FOLLOWER
I20260811 16:50:06.138613 23806 consensus_queue.cc:260] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "514ba091c2a44e218df1ee7f45d5fe3b" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 36645 } }
I20260811 16:50:06.138724 23806 raft_consensus.cc:388] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:50:06.138772 23806 raft_consensus.cc:482] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:50:06.138823 23806 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:06.139710 23806 raft_consensus.cc:504] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "514ba091c2a44e218df1ee7f45d5fe3b" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 36645 } }
I20260811 16:50:06.139832 23806 leader_election.cc:302] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 514ba091c2a44e218df1ee7f45d5fe3b; no voters:
I20260811 16:50:06.140048 23806 leader_election.cc:288] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:50:06.140071 23813 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:50:06.140201 23813 raft_consensus.cc:686] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [term 1 LEADER]: Becoming Leader. State: Replica: 514ba091c2a44e218df1ee7f45d5fe3b, State: Running, Role: LEADER
I20260811 16:50:06.140331 23806 sys_catalog.cc:564] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:50:06.140348 23813 consensus_queue.cc:237] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "514ba091c2a44e218df1ee7f45d5fe3b" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 36645 } }
I20260811 16:50:06.140805 23814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "514ba091c2a44e218df1ee7f45d5fe3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "514ba091c2a44e218df1ee7f45d5fe3b" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 36645 } } }
I20260811 16:50:06.140918 23814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [sys.catalog]: This master's current role is: LEADER
I20260811 16:50:06.140818 23815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 514ba091c2a44e218df1ee7f45d5fe3b. Latest consensus state: current_term: 1 leader_uuid: "514ba091c2a44e218df1ee7f45d5fe3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "514ba091c2a44e218df1ee7f45d5fe3b" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 36645 } } }
I20260811 16:50:06.140966 23815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b [sys.catalog]: This master's current role is: LEADER
I20260811 16:50:06.141139 23823 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:50:06.141741 23823 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:50:06.143864 23823 catalog_manager.cc:1347] Generated new cluster ID: bc1eae2a9b1e4213a2802dcd11a4df0e
I20260811 16:50:06.143920 23823 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:50:06 dist-test-slave-3h5h krb5kdc[23668](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:06.148379 23812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:06.137375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45546 (local address 127.2.55.190:36645)
0811 16:50:06.137570 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:06.137583 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:06.137609 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:50:06.138096 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:06.138102 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:06.138151 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:06.138314 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:06.139090 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:06.140195 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:06.141333 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:06.141991 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:06.142493 (+ 502us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:06.144859 (+ 2366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:06.144864 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:06.144865 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:06.144877 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:06.146635 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:06.147039 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:06.147042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:06.147043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:06.147161 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:06.147383 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:06.147384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:06.147385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:06.147639 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:06.147822 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:06.147892 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 16:50:06.148034 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":114,"threads_started":1}
I20260811 16:50:06.149677 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:50:06.167095 23823 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:50:06.167704 23823 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:50:06.178364 23823 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 514ba091c2a44e218df1ee7f45d5fe3b: Generated new TSK 0
I20260811 16:50:06.178594 23823 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:50:06.204144 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 23690
2026-08-11T16:50:06Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1635 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:50:06 dist-test-slave-3h5h krb5kdc[23850](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:50:06 dist-test-slave-3h5h krb5kdc[23850](info): set up 2 sockets
Aug 11 16:50:06 dist-test-slave-3h5h krb5kdc[23850](info): commencing operation
krb5kdc: starting...
W20260811 16:50:07.467360 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:50:07 dist-test-slave-3h5h krb5kdc[23850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:50:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:50:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:50:07.600060 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:35553
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:35553
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:50:07.686242 23874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:07.686480 23874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:07.686518 23874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:07.687666 23874 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:50:07.687736 23874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:07.687759 23874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:07.687786 23874 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:50:07.687809 23874 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:50:07.689381 23874 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:35553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:35553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23874
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:07.689673 23874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:07.689909 23874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:07.694950 23885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:07.694979 23874 server_base.cc:1034] running on GCE node
W20260811 16:50:07.694985 23886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:07.694950 23890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:07.695411 23874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:07.695657 23874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:07.696800 23874 hybrid_clock.cc:648] HybridClock initialized: now 1786467007696779 us; error 40 us; skew 500 ppm
Aug 11 16:50:07 dist-test-slave-3h5h krb5kdc[23850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467007, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:07.699401 23874 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:50:07.699892 23874 webserver.cc:460] Webserver started at http://127.2.55.190:33739/ using document root <none> and password file <none>
I20260811 16:50:07.700129 23874 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:07.700176 23874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:07.700316 23874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:50:07.701498 23874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "4aa972f4ad084985b7bea20f0fadc824"
format_stamp: "Formatted at 2026-08-11 16:50:07 on dist-test-slave-3h5h"
server_key: "15b73601a4b0538cd09980f21858bd87"
server_key_iv: "62d955641f755ec0e08e704d3303a8be"
server_key_version: "encryptionkey@0"
I20260811 16:50:07.701866 23874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "4aa972f4ad084985b7bea20f0fadc824"
format_stamp: "Formatted at 2026-08-11 16:50:07 on dist-test-slave-3h5h"
server_key: "15b73601a4b0538cd09980f21858bd87"
server_key_iv: "62d955641f755ec0e08e704d3303a8be"
server_key_version: "encryptionkey@0"
I20260811 16:50:07.703327 23874 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:50:07.704100 23905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:07.704344 23874 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:07.704425 23874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "4aa972f4ad084985b7bea20f0fadc824"
format_stamp: "Formatted at 2026-08-11 16:50:07 on dist-test-slave-3h5h"
server_key: "15b73601a4b0538cd09980f21858bd87"
server_key_iv: "62d955641f755ec0e08e704d3303a8be"
server_key_version: "encryptionkey@0"
I20260811 16:50:07.704519 23874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:07.723191 23874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:07.725153 23874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:07.725329 23874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:07.729914 23874 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:35553
I20260811 16:50:07.730015 23996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:35553 every 8 connection(s)
I20260811 16:50:07.730352 23874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:50:07.731398 23997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:07.733932 23997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824: Bootstrap starting.
I20260811 16:50:07.734548 23997 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:07.734867 23997 log.cc:824] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:07.735644 23997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824: No bootstrap required, opened a new log
I20260811 16:50:07.736486 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 23874
I20260811 16:50:07.736613 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:50:07.736850 2270 external_mini_cluster.cc:1428] Setting key 3f9d1c2b8e9a79a6fab3aad8327297ad
I20260811 16:50:07.738024 23997 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } }
I20260811 16:50:07.738166 23997 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:07.738193 23997 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4aa972f4ad084985b7bea20f0fadc824, State: Initialized, Role: FOLLOWER
I20260811 16:50:07.738348 23997 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } }
I20260811 16:50:07.738461 23997 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:50:07.738502 23997 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:50:07.738561 23997 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:07.739687 23997 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } }
I20260811 16:50:07.739785 23997 leader_election.cc:302] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4aa972f4ad084985b7bea20f0fadc824; no voters:
I20260811 16:50:07.740016 23997 leader_election.cc:288] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:50:07.740091 24006 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:50:07.740259 24006 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 1 LEADER]: Becoming Leader. State: Replica: 4aa972f4ad084985b7bea20f0fadc824, State: Running, Role: LEADER
I20260811 16:50:07.740345 23997 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:50:07.740437 24006 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } }
I20260811 16:50:07.741017 24007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4aa972f4ad084985b7bea20f0fadc824" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } } }
I20260811 16:50:07.741123 24007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [sys.catalog]: This master's current role is: LEADER
I20260811 16:50:07.741307 24010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4aa972f4ad084985b7bea20f0fadc824. Latest consensus state: current_term: 1 leader_uuid: "4aa972f4ad084985b7bea20f0fadc824" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } } }
I20260811 16:50:07.741360 24010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [sys.catalog]: This master's current role is: LEADER
I20260811 16:50:07.741758 24018 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:50:07.742435 24018 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:50:07.744086 24018 catalog_manager.cc:1347] Generated new cluster ID: e90854db0b3a42cd8e62e65b5629986b
I20260811 16:50:07.744146 24018 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:50:07 dist-test-slave-3h5h krb5kdc[23850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:07.750526 24005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:07.737551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46094 (local address 127.2.55.190:35553)
0811 16:50:07.737767 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:07.737786 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:07.737824 (+ 38us) server_negotiation.cc:407] Connection header received
0811 16:50:07.738031 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:07.738038 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:07.738115 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:07.738352 (+ 237us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:07.739244 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:07.740815 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:07.742368 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:07.743132 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:07.743260 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:07.746560 (+ 3300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:07.746565 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:07.746566 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:07.746579 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:07.748650 (+ 2071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:07.749146 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:07.749149 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:07.749149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:07.749294 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:07.749564 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:07.749565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:07.749566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:07.749864 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:07.750025 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:07.750186 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 16:50:07.750324 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":117,"threads_started":1}
I20260811 16:50:07.752969 24018 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:50:07.753507 24018 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:50:07.757368 24018 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824: Generated new TSK 0
I20260811 16:50:07.757560 24018 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:50:07.792657 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:35553
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:50:07.887452 24035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:07.887719 24035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:07.887755 24035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:07.889024 24035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:07.889089 24035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:07.889134 24035 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:50:07.890653 24035 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:35553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:07.890945 24035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:07.891211 24035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:07.896488 24045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:07.896644 24035 server_base.cc:1034] running on GCE node
W20260811 16:50:07.896754 24043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:07.896476 24049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:07.897022 24035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:07.897275 24035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:07.898461 24035 hybrid_clock.cc:648] HybridClock initialized: now 1786467007898448 us; error 34 us; skew 500 ppm
Aug 11 16:50:07 dist-test-slave-3h5h krb5kdc[23850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467007, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:07.901117 24035 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:50:07.901571 24035 webserver.cc:460] Webserver started at http://127.2.55.129:38765/ using document root <none> and password file <none>
I20260811 16:50:07.901834 24035 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:07.901906 24035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:07.902063 24035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:50:07.903165 24035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "d031912b02c4474f9b40d35ded798eb9"
format_stamp: "Formatted at 2026-08-11 16:50:07 on dist-test-slave-3h5h"
server_key: "57d21629271b2fe0d4d72b0769f6a541"
server_key_iv: "5034a268f921404234cd84311ac0279f"
server_key_version: "encryptionkey@0"
I20260811 16:50:07.903545 24035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "d031912b02c4474f9b40d35ded798eb9"
format_stamp: "Formatted at 2026-08-11 16:50:07 on dist-test-slave-3h5h"
server_key: "57d21629271b2fe0d4d72b0769f6a541"
server_key_iv: "5034a268f921404234cd84311ac0279f"
server_key_version: "encryptionkey@0"
I20260811 16:50:07.904973 24035 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:50:07.905789 24061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:07.905978 24035 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:07.906083 24035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "d031912b02c4474f9b40d35ded798eb9"
format_stamp: "Formatted at 2026-08-11 16:50:07 on dist-test-slave-3h5h"
server_key: "57d21629271b2fe0d4d72b0769f6a541"
server_key_iv: "5034a268f921404234cd84311ac0279f"
server_key_version: "encryptionkey@0"
I20260811 16:50:07.906168 24035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:07.931373 24035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:07.933542 24035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:07.933750 24035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:07.934022 24035 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:50:07.934362 24035 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:50:07.934420 24035 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:07.934463 24035 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:50:07.934492 24035 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:07.940619 24035 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:43603
I20260811 16:50:07.940666 24252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:43603 every 8 connection(s)
I20260811 16:50:07.941071 24035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:50:07 dist-test-slave-3h5h krb5kdc[23850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467007, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:07.950013 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 24035
I20260811 16:50:07.950155 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:50:07.950417 2270 external_mini_cluster.cc:1428] Setting key 7df83c030d3105cafefd012d43dc8f6b
I20260811 16:50:07.951012 24005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:07.941923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:40365 (local address 127.2.55.190:35553)
0811 16:50:07.941997 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:07.941999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:07.942244 (+ 245us) server_negotiation.cc:407] Connection header received
0811 16:50:07.942731 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:07.942732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:07.942743 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:07.942804 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:07.943770 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:07.944272 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:07.945387 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:07.945601 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:07.945663 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:07.947996 (+ 2333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:07.947997 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:07.947997 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:07.948008 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:07.949382 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:07.949841 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:07.949842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:07.949843 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:07.949914 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:07.950209 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:07.950210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:07.950211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:07.950370 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:07.950450 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:07.950848 (+ 398us) server_negotiation.cc:299] Negotiation successful
0811 16:50:07.950944 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 16:50:07.951251 24256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:07.941882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:40365)
0811 16:50:07.942078 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:07.942127 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:07.942631 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:07.942855 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:07.942858 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:07.943456 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:07.943654 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:07.943659 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:07.944367 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:07.944368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:07.945289 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:07.945292 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:07.945696 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:07.945696 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:07.945799 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:07.946405 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:07.946414 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:07.947904 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:07.949466 (+ 1562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:07.949474 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:07.949476 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:07.949732 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:07.949994 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:07.949994 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:07.949995 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:07.950107 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:07.950446 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:07.950453 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:07.950659 (+ 206us) client_negotiation.cc:769] Sending connection context
0811 16:50:07.950802 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 16:50:07.951001 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":117,"threads_started":1}
I20260811 16:50:07.951776 24254 heartbeater.cc:347] Connected to a master server at 127.2.55.190:35553
I20260811 16:50:07.951876 24254 heartbeater.cc:464] Registering TS with master...
I20260811 16:50:07.952090 24254 heartbeater.cc:511] Master 127.2.55.190:35553 requested a full tablet report, sending...
I20260811 16:50:07.952666 23934 ts_manager.cc:194] Registered new tserver with Master: d031912b02c4474f9b40d35ded798eb9 (127.2.55.129:43603)
I20260811 16:50:07.953485 23934 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:40365
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:50:07.980628 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:35553
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:50:08.070221 24263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:08.070442 24263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:08.070469 24263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:08.071669 24263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:08.071715 24263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:08.071743 24263 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:50:08.073273 24263 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:35553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:08.073475 24263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:08.073673 24263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:08.079094 24271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:08.079111 24275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:08.079159 24263 server_base.cc:1034] running on GCE node
W20260811 16:50:08.079047 24269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:08.079419 24263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:08.079651 24263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:08.080817 24263 hybrid_clock.cc:648] HybridClock initialized: now 1786467008080802 us; error 31 us; skew 500 ppm
Aug 11 16:50:08 dist-test-slave-3h5h krb5kdc[23850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467008, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:08.083786 24263 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:50:08.084434 24263 webserver.cc:460] Webserver started at http://127.2.55.130:45629/ using document root <none> and password file <none>
I20260811 16:50:08.084729 24263 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:08.084779 24263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:08.084964 24263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:50:08.086035 24263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "18c06a4fd16a43f4a88844af44dfb944"
format_stamp: "Formatted at 2026-08-11 16:50:08 on dist-test-slave-3h5h"
server_key: "95b84dea70c0fc24beb83eed7555c5c4"
server_key_iv: "6f3663f93815561001daffb2b81067c3"
server_key_version: "encryptionkey@0"
I20260811 16:50:08.086397 24263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "18c06a4fd16a43f4a88844af44dfb944"
format_stamp: "Formatted at 2026-08-11 16:50:08 on dist-test-slave-3h5h"
server_key: "95b84dea70c0fc24beb83eed7555c5c4"
server_key_iv: "6f3663f93815561001daffb2b81067c3"
server_key_version: "encryptionkey@0"
I20260811 16:50:08.087855 24263 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:50:08.088639 24286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:08.088819 24263 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:50:08.088971 24263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "18c06a4fd16a43f4a88844af44dfb944"
format_stamp: "Formatted at 2026-08-11 16:50:08 on dist-test-slave-3h5h"
server_key: "95b84dea70c0fc24beb83eed7555c5c4"
server_key_iv: "6f3663f93815561001daffb2b81067c3"
server_key_version: "encryptionkey@0"
I20260811 16:50:08.089057 24263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:08.096645 24263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:08.099071 24263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:08.099243 24263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:08.099481 24263 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:50:08.099820 24263 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:50:08.099876 24263 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:08.099920 24263 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:50:08.099947 24263 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:08.106129 24263 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:41455
I20260811 16:50:08.106195 24467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:41455 every 8 connection(s)
I20260811 16:50:08.106513 24263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:50:08 dist-test-slave-3h5h krb5kdc[23850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467008, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:08.115892 24005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.107329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:52973 (local address 127.2.55.190:35553)
0811 16:50:08.107415 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:08.107417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:08.107645 (+ 228us) server_negotiation.cc:407] Connection header received
0811 16:50:08.108142 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:08.108143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:08.108154 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:08.108247 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:08.109379 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.109878 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.110892 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.111101 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.111158 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.113224 (+ 2066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:08.113225 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:08.113226 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:08.113233 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:08.114728 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:08.115088 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:08.115089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:08.115089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:08.115141 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:08.115358 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:08.115359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:08.115359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:08.115460 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:08.115512 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:08.115752 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 16:50:08.115824 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 16:50:08.116041 24472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.107309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:52973)
0811 16:50:08.107505 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:08.107548 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:08.108034 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:08.108299 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:08.108302 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:08.109023 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:08.109298 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.109303 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.109962 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.109963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.110816 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.110819 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.111181 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.111182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.111285 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.111740 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:08.111748 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:08.113133 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:08.114799 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:08.114806 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:08.114807 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:08.115020 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:08.115209 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:08.115209 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:08.115210 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:08.115304 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:08.115515 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:08.115519 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:08.115626 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 16:50:08.115725 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 16:50:08.115844 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":114,"threads_started":1}
I20260811 16:50:08.116568 24468 heartbeater.cc:347] Connected to a master server at 127.2.55.190:35553
I20260811 16:50:08.116600 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 24263
I20260811 16:50:08.116665 24468 heartbeater.cc:464] Registering TS with master...
I20260811 16:50:08.116731 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:50:08.116904 24468 heartbeater.cc:511] Master 127.2.55.190:35553 requested a full tablet report, sending...
I20260811 16:50:08.117015 2270 external_mini_cluster.cc:1428] Setting key bf9267c05aead60e949214c75f7fefee
I20260811 16:50:08.117347 23934 ts_manager.cc:194] Registered new tserver with Master: 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455)
I20260811 16:50:08.117882 23934 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:52973
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:50:08.144110 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:35553
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:50:08.228545 24478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:08.228745 24478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:08.228768 24478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:08.229918 24478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:08.229962 24478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:08.229990 24478 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:50:08.231462 24478 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:35553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:08.231714 24478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:08.231984 24478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:08.237114 24486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:08.237154 24478 server_base.cc:1034] running on GCE node
W20260811 16:50:08.237123 24485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:08.237128 24488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:08.237586 24478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:08.237848 24478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:08.239012 24478 hybrid_clock.cc:648] HybridClock initialized: now 1786467008239003 us; error 47 us; skew 500 ppm
Aug 11 16:50:08 dist-test-slave-3h5h krb5kdc[23850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467008, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:08.245436 24478 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:50:08.245927 24478 webserver.cc:460] Webserver started at http://127.2.55.131:43655/ using document root <none> and password file <none>
I20260811 16:50:08.246285 24478 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:08.246362 24478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:08.246529 24478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:50:08.247682 24478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "1a179660b61946a9b0b79cac74f427d3"
format_stamp: "Formatted at 2026-08-11 16:50:08 on dist-test-slave-3h5h"
server_key: "5c223c480d4b9c9203c18207de84cf44"
server_key_iv: "b71575f24ee2d7b43cd917c79c8559cd"
server_key_version: "encryptionkey@0"
I20260811 16:50:08.248122 24478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "1a179660b61946a9b0b79cac74f427d3"
format_stamp: "Formatted at 2026-08-11 16:50:08 on dist-test-slave-3h5h"
server_key: "5c223c480d4b9c9203c18207de84cf44"
server_key_iv: "b71575f24ee2d7b43cd917c79c8559cd"
server_key_version: "encryptionkey@0"
I20260811 16:50:08.249781 24478 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 16:50:08.250641 24497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:08.250852 24478 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:08.250949 24478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "1a179660b61946a9b0b79cac74f427d3"
format_stamp: "Formatted at 2026-08-11 16:50:08 on dist-test-slave-3h5h"
server_key: "5c223c480d4b9c9203c18207de84cf44"
server_key_iv: "b71575f24ee2d7b43cd917c79c8559cd"
server_key_version: "encryptionkey@0"
I20260811 16:50:08.251065 24478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:08.261413 24478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:08.263659 24478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:08.263772 24478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:08.263940 24478 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:50:08.264259 24478 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:50:08.264293 24478 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:08.264314 24478 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:50:08.264364 24478 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:08.270470 24478 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:39571
I20260811 16:50:08.270530 24667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:39571 every 8 connection(s)
I20260811 16:50:08.270857 24478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:50:08 dist-test-slave-3h5h krb5kdc[23850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467008, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:08.279904 24005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.271609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:44743 (local address 127.2.55.190:35553)
0811 16:50:08.271696 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:08.271699 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:08.271878 (+ 179us) server_negotiation.cc:407] Connection header received
0811 16:50:08.272406 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:08.272408 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:08.272421 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:08.272479 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:08.273528 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.274057 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.275061 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.275269 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.275345 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.277539 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:08.277541 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:08.277541 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:08.277548 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:08.278768 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:08.279134 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:08.279135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:08.279135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:08.279186 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:08.279392 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:08.279393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:08.279393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:08.279490 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:08.279540 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:08.279775 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 16:50:08.279840 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 16:50:08.280022 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 24478
I20260811 16:50:08.280123 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:50:08.280241 24672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.271565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:44743)
0811 16:50:08.271748 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:08.271796 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:08.272299 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:08.272574 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:08.272578 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:08.273222 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:08.273407 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.273411 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.274157 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.274159 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.274954 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.274956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.275352 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.275354 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.275479 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.276001 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:08.276010 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:08.277445 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:08.278839 (+ 1394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:08.278845 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:08.278847 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:08.279068 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:08.279245 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:08.279246 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:08.279246 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:08.279340 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:08.279548 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:08.279553 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:08.279663 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 16:50:08.279747 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 16:50:08.279907 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":106,"threads_started":1}
I20260811 16:50:08.280323 2270 external_mini_cluster.cc:1428] Setting key 760816622761b6b829eba82df4aee56e
I20260811 16:50:08.280786 24668 heartbeater.cc:347] Connected to a master server at 127.2.55.190:35553
I20260811 16:50:08.280947 24668 heartbeater.cc:464] Registering TS with master...
I20260811 16:50:08.281153 24668 heartbeater.cc:511] Master 127.2.55.190:35553 requested a full tablet report, sending...
I20260811 16:50:08.281646 23934 ts_manager.cc:194] Registered new tserver with Master: 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131:39571)
I20260811 16:50:08.281977 23934 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:44743
I20260811 16:50:08.292414 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:50:08.300498 24005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.293918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46102 (local address 127.2.55.190:35553)
0811 16:50:08.294022 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:08.294025 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:08.294114 (+ 89us) server_negotiation.cc:407] Connection header received
0811 16:50:08.294202 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:08.294203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:08.294215 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:08.294267 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:08.294847 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.295345 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.296167 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.296381 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.296458 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.297741 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:08.297743 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:08.297743 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:08.297750 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:08.299218 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:08.299600 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:08.299601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:08.299601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:08.299663 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:08.299875 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:08.299877 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:08.299877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:08.300059 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:08.300204 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:08.300308 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 16:50:08.300392 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 16:50:08.302577 23934 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46102:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:50:08.304294 23934 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:50:08.311545 24690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.307205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32802 (local address 127.2.55.131:39571)
0811 16:50:08.307405 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:08.307410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:08.307481 (+ 71us) server_negotiation.cc:407] Connection header received
0811 16:50:08.307549 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:08.307551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:08.307568 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:08.307758 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:08.308137 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.309491 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.310612 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.311101 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.311188 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.311251 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:08.311420 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 16:50:08.311461 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":79,"threads_started":1}
I20260811 16:50:08.311545 24689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.307011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:39571 (local address 127.0.0.1:32802)
0811 16:50:08.307388 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:08.307399 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:08.307473 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:08.307982 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:08.307983 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:08.307985 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:08.308030 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.308031 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.309599 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.309600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.310471 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.310474 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.311200 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.311201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.311284 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.311298 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:50:08.311401 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 16:50:08.311458 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":34,"thread_start_us":108,"threads_started":1}
I20260811 16:50:08.311831 24688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.306945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:43603 (local address 127.0.0.1:53834)
0811 16:50:08.307201 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:08.307252 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:08.307323 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:08.307709 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:08.307713 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:08.307715 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:08.307793 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.307795 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.309375 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.309377 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.310514 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.310517 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.311548 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.311549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.311625 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.311631 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:50:08.311696 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 16:50:08.311729 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":12,"thread_start_us":52,"threads_started":1}
I20260811 16:50:08.311841 24687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.307080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:41455 (local address 127.0.0.1:47346)
0811 16:50:08.307548 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:08.307557 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:08.307610 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:08.307880 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:08.307881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:08.307883 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:08.307927 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.307928 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.309115 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.309117 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.310515 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.310517 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.311549 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.311550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.311625 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.311633 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 16:50:08.311684 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 16:50:08.311729 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"mutex_wait_us":7,"thread_start_us":77,"threads_started":1}
I20260811 16:50:08.311913 24691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.307200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47346 (local address 127.2.55.130:41455)
0811 16:50:08.307498 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:08.307502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:08.307623 (+ 121us) server_negotiation.cc:407] Connection header received
0811 16:50:08.307772 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:08.307776 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:08.307793 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:08.307871 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:08.307990 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.309013 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.310623 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.311378 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.311454 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.311508 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:08.311777 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 16:50:08.311824 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":94,"threads_started":1}
I20260811 16:50:08.312587 24367 tablet_service.cc:1467] Processing CreateTablet for tablet 5c657199eafd4fd19780e3149994970e (DEFAULT_TABLE table=test-table [id=dbab770973ca4b27a888bd596bf86ff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:50:08.312767 24563 tablet_service.cc:1467] Processing CreateTablet for tablet 5c657199eafd4fd19780e3149994970e (DEFAULT_TABLE table=test-table [id=dbab770973ca4b27a888bd596bf86ff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:50:08.312991 24367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c657199eafd4fd19780e3149994970e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:08.313076 24696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.307252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53834 (local address 127.2.55.129:43603)
0811 16:50:08.307495 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:08.307501 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:08.307509 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:50:08.307549 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:08.307551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:08.307568 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:08.307648 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:08.307869 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.309259 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.310623 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.311393 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.311454 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.311508 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:08.312928 (+ 1420us) server_negotiation.cc:299] Negotiation successful
0811 16:50:08.312990 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":104,"threads_started":1}
I20260811 16:50:08.313138 24563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c657199eafd4fd19780e3149994970e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:08.313717 24153 tablet_service.cc:1467] Processing CreateTablet for tablet 5c657199eafd4fd19780e3149994970e (DEFAULT_TABLE table=test-table [id=dbab770973ca4b27a888bd596bf86ff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:50:08.314025 24153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c657199eafd4fd19780e3149994970e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:08.315685 24698 tablet_bootstrap.cc:492] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3: Bootstrap starting.
I20260811 16:50:08.316401 24698 tablet_bootstrap.cc:654] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:08.316380 24699 tablet_bootstrap.cc:492] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944: Bootstrap starting.
I20260811 16:50:08.317134 24699 tablet_bootstrap.cc:654] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:08.317119 24698 log.cc:824] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:08.317220 24700 tablet_bootstrap.cc:492] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9: Bootstrap starting.
I20260811 16:50:08.317786 24699 log.cc:824] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:08.317919 24700 tablet_bootstrap.cc:654] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:08.317940 24698 tablet_bootstrap.cc:492] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3: No bootstrap required, opened a new log
I20260811 16:50:08.318017 24698 ts_tablet_manager.cc:1397] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:50:08.318506 24700 log.cc:824] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:08.318624 24699 tablet_bootstrap.cc:492] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944: No bootstrap required, opened a new log
I20260811 16:50:08.318693 24699 ts_tablet_manager.cc:1397] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:50:08.319324 24700 tablet_bootstrap.cc:492] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9: No bootstrap required, opened a new log
I20260811 16:50:08.319428 24700 ts_tablet_manager.cc:1397] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:50:08.319891 24698 raft_consensus.cc:348] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } }
I20260811 16:50:08.320062 24698 raft_consensus.cc:374] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:08.320111 24698 raft_consensus.cc:729] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a179660b61946a9b0b79cac74f427d3, State: Initialized, Role: FOLLOWER
I20260811 16:50:08.320222 24698 consensus_queue.cc:260] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } }
I20260811 16:50:08.320520 24698 ts_tablet_manager.cc:1428] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:50:08.320537 24668 heartbeater.cc:503] Master 127.2.55.190:35553 was elected leader, sending a full tablet report...
I20260811 16:50:08.320763 24699 raft_consensus.cc:348] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } }
I20260811 16:50:08.320994 24699 raft_consensus.cc:374] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:08.321041 24699 raft_consensus.cc:729] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c06a4fd16a43f4a88844af44dfb944, State: Initialized, Role: FOLLOWER
I20260811 16:50:08.321151 24699 consensus_queue.cc:260] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } }
I20260811 16:50:08.321422 24699 ts_tablet_manager.cc:1428] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:50:08.321435 24468 heartbeater.cc:503] Master 127.2.55.190:35553 was elected leader, sending a full tablet report...
I20260811 16:50:08.321777 24700 raft_consensus.cc:348] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } }
I20260811 16:50:08.321930 24700 raft_consensus.cc:374] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:08.321970 24700 raft_consensus.cc:729] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d031912b02c4474f9b40d35ded798eb9, State: Initialized, Role: FOLLOWER
I20260811 16:50:08.322096 24700 consensus_queue.cc:260] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } }
I20260811 16:50:08.322402 24700 ts_tablet_manager.cc:1428] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:50:08.322582 24254 heartbeater.cc:503] Master 127.2.55.190:35553 was elected leader, sending a full tablet report...
I20260811 16:50:08.345932 24710 raft_consensus.cc:482] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:50:08.346061 24710 raft_consensus.cc:504] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } }
I20260811 16:50:08.346393 24710 leader_election.cc:288] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455), 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131:39571)
I20260811 16:50:08.349529 24256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.346572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:39571 (local address 127.2.55.129:39027)
0811 16:50:08.346625 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:08.346637 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:08.346686 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:08.346857 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:08.346858 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:08.346860 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:08.346960 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.346963 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.347729 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.347730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.348582 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.348584 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.349247 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.349248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.349331 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.349335 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:50:08.349405 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 16:50:08.349453 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 16:50:08.349561 24690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.346656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:39027 (local address 127.2.55.131:39571)
0811 16:50:08.346720 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:08.346722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:08.346733 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:50:08.346761 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:08.346762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:08.346773 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:08.346832 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:08.347046 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.347650 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.348678 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.349151 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.349216 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.349224 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:08.349441 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 16:50:08.349479 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 16:50:08.349720 24711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.346572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:41455 (local address 127.2.55.129:33679)
0811 16:50:08.346947 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:08.346958 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:08.347023 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:08.347220 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:08.347221 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:08.347224 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:08.347296 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.347298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.347993 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.347994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.348793 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.348795 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.349447 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.349448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.349517 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.349522 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:50:08.349580 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 16:50:08.349622 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":168,"thread_start_us":127,"threads_started":1}
I20260811 16:50:08.349786 24691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.346659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:33679 (local address 127.2.55.130:41455)
0811 16:50:08.346720 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:08.346722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:08.347090 (+ 368us) server_negotiation.cc:407] Connection header received
0811 16:50:08.347128 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:08.347129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:08.347141 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:08.347181 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:08.347369 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.347905 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.348902 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.349360 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.349427 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.349436 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:08.349601 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 16:50:08.349713 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:50:08.349911 24598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c657199eafd4fd19780e3149994970e" candidate_uuid: "d031912b02c4474f9b40d35ded798eb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a179660b61946a9b0b79cac74f427d3" is_pre_election: true
I20260811 16:50:08.350111 24598 raft_consensus.cc:2454] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d031912b02c4474f9b40d35ded798eb9 in term 0.
I20260811 16:50:08.350107 24393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c657199eafd4fd19780e3149994970e" candidate_uuid: "d031912b02c4474f9b40d35ded798eb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c06a4fd16a43f4a88844af44dfb944" is_pre_election: true
I20260811 16:50:08.350261 24393 raft_consensus.cc:2454] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d031912b02c4474f9b40d35ded798eb9 in term 0.
I20260811 16:50:08.350386 24066 leader_election.cc:302] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a179660b61946a9b0b79cac74f427d3, d031912b02c4474f9b40d35ded798eb9; no voters:
I20260811 16:50:08.350567 24710 raft_consensus.cc:2781] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:50:08.350610 24710 raft_consensus.cc:482] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:50:08.350625 24710 raft_consensus.cc:3037] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:08.351311 24710 raft_consensus.cc:504] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } }
I20260811 16:50:08.351460 24710 leader_election.cc:288] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 1 election: Requested vote from peers 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455), 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131:39571)
I20260811 16:50:08.351629 24393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c657199eafd4fd19780e3149994970e" candidate_uuid: "d031912b02c4474f9b40d35ded798eb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c06a4fd16a43f4a88844af44dfb944"
I20260811 16:50:08.351647 24598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c657199eafd4fd19780e3149994970e" candidate_uuid: "d031912b02c4474f9b40d35ded798eb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a179660b61946a9b0b79cac74f427d3"
I20260811 16:50:08.351733 24598 raft_consensus.cc:3037] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:08.351738 24393 raft_consensus.cc:3037] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:08.352484 24598 raft_consensus.cc:2454] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d031912b02c4474f9b40d35ded798eb9 in term 1.
I20260811 16:50:08.352567 24393 raft_consensus.cc:2454] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d031912b02c4474f9b40d35ded798eb9 in term 1.
I20260811 16:50:08.352660 24066 leader_election.cc:302] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a179660b61946a9b0b79cac74f427d3, d031912b02c4474f9b40d35ded798eb9; no voters:
I20260811 16:50:08.352762 24710 raft_consensus.cc:2781] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:50:08.352941 24710 raft_consensus.cc:686] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [term 1 LEADER]: Becoming Leader. State: Replica: d031912b02c4474f9b40d35ded798eb9, State: Running, Role: LEADER
I20260811 16:50:08.353060 24710 consensus_queue.cc:237] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } }
I20260811 16:50:08.354048 23934 catalog_manager.cc:5495] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d031912b02c4474f9b40d35ded798eb9 (127.2.55.129). New cstate: current_term: 1 leader_uuid: "d031912b02c4474f9b40d35ded798eb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } health_report { overall_health: UNKNOWN } } }
W20260811 16:50:08.357182 24471 tablet.cc:2369] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:50:08.359613 24696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.357489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53838 (local address 127.2.55.129:43603)
0811 16:50:08.357543 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:08.357545 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:08.357552 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:50:08.357628 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:08.357629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:08.357653 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:08.357713 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:50:08.357802 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.358245 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.358944 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.359118 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.359166 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.359296 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:50:08.359388 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:50:08.359448 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:08.359480 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 16:50:08.359497 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:50:08.361330 24393 raft_consensus.cc:1261] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944 [term 1 FOLLOWER]: Refusing update from remote peer d031912b02c4474f9b40d35ded798eb9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:50:08.361330 24598 raft_consensus.cc:1261] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3 [term 1 FOLLOWER]: Refusing update from remote peer d031912b02c4474f9b40d35ded798eb9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:50:08.361691 24712 consensus_queue.cc:1035] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:50:08.361829 24710 consensus_queue.cc:1035] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:50:08.366865 23933 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:50:08.366976 23933 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:50:08.367772 23933 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824: Sending DeleteTablet for 3 replicas of tablet 5c657199eafd4fd19780e3149994970e
I20260811 16:50:08.368095 24153 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c657199eafd4fd19780e3149994970e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:50:08 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:53834
I20260811 16:50:08.368132 24367 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c657199eafd4fd19780e3149994970e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:50:08 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:47346
I20260811 16:50:08.368135 24563 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c657199eafd4fd19780e3149994970e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:50:08 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:32802
I20260811 16:50:08.368201 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 24035
I20260811 16:50:08.383093 24737 tablet_replica.cc:330] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944: stopping tablet replica
I20260811 16:50:08.383299 24737 raft_consensus.cc:2229] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:50:08.383463 24737 raft_consensus.cc:2258] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:50:08.383679 24733 tablet_replica.cc:330] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3: stopping tablet replica
I20260811 16:50:08.383813 24733 raft_consensus.cc:2229] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:50:08.383920 24733 raft_consensus.cc:2258] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:50:08.384068 24737 ts_tablet_manager.cc:1905] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:50:08.384368 24733 ts_tablet_manager.cc:1905] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:50:08.386210 24733 ts_tablet_manager.cc:1918] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:50:08.386281 24737 ts_tablet_manager.cc:1918] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:50:08.386313 24733 log.cc:1196] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/5c657199eafd4fd19780e3149994970e
I20260811 16:50:08.386412 24737 log.cc:1196] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/5c657199eafd4fd19780e3149994970e
I20260811 16:50:08.386613 24733 ts_tablet_manager.cc:1939] T 5c657199eafd4fd19780e3149994970e P 1a179660b61946a9b0b79cac74f427d3: Deleting consensus metadata
I20260811 16:50:08.386724 24737 ts_tablet_manager.cc:1939] T 5c657199eafd4fd19780e3149994970e P 18c06a4fd16a43f4a88844af44dfb944: Deleting consensus metadata
I20260811 16:50:08.387146 23908 catalog_manager.cc:4841] TS 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131:39571): tablet 5c657199eafd4fd19780e3149994970e (table test-table [id=dbab770973ca4b27a888bd596bf86ff0]) successfully deleted
I20260811 16:50:08.387197 23909 catalog_manager.cc:4841] TS 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455): tablet 5c657199eafd4fd19780e3149994970e (table test-table [id=dbab770973ca4b27a888bd596bf86ff0]) successfully deleted
W20260811 16:50:08.388535 23907 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.55.129:43603 (error 108)
I20260811 16:50:08.388872 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 24263
I20260811 16:50:08.391057 24688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.388975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:43603 (local address 127.0.0.1:53846)
0811 16:50:08.390942 (+ 1967us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:08.390997 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:43603: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1935}
W20260811 16:50:08.393303 23907 catalog_manager.cc:4584] TS d031912b02c4474f9b40d35ded798eb9 (127.2.55.129:43603): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5c657199eafd4fd19780e3149994970e: Network error: Client connection negotiation failed: client connection to 127.2.55.129:43603: connect: Connection refused (error 111)
I20260811 16:50:08.403460 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 24478
I20260811 16:50:08.417934 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 23874
I20260811 16:50:08.426234 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:35553
--webserver_interface=127.2.55.190
--webserver_port=33739
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:35553
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:50:08.513125 24742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:08.513343 24742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:08.513368 24742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:08.514498 24742 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:50:08.514544 24742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:08.514559 24742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:08.514575 24742 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:50:08.514596 24742 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:50:08.516070 24742 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:35553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:35553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=33739
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:08.516280 24742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:08.516479 24742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:08.526389 24755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:08.526413 24753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:08.526475 24751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:08.526928 24742 server_base.cc:1034] running on GCE node
I20260811 16:50:08.527226 24742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:08.527545 24742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:08.528716 24742 hybrid_clock.cc:648] HybridClock initialized: now 1786467008528701 us; error 48 us; skew 500 ppm
Aug 11 16:50:08 dist-test-slave-3h5h krb5kdc[23850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467008, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:08.531322 24742 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:50:08.531831 24742 webserver.cc:460] Webserver started at http://127.2.55.190:33739/ using document root <none> and password file <none>
I20260811 16:50:08.532090 24742 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:08.532186 24742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:08.533654 24742 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:50:08.534348 24765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:08.534523 24742 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:50:08.534633 24742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "4aa972f4ad084985b7bea20f0fadc824"
format_stamp: "Formatted at 2026-08-11 16:50:07 on dist-test-slave-3h5h"
server_key: "15b73601a4b0538cd09980f21858bd87"
server_key_iv: "62d955641f755ec0e08e704d3303a8be"
server_key_version: "encryptionkey@0"
I20260811 16:50:08.535033 24742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:08.549604 24742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:08.552008 24742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:08.552184 24742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:08.556643 24742 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:35553
I20260811 16:50:08.556689 24847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:35553 every 8 connection(s)
I20260811 16:50:08.557193 24742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:50:08.558945 24848 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:50:08.559653 24848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824: Bootstrap starting.
I20260811 16:50:08.562042 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 24742
I20260811 16:50:08.562388 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:43603
--local_ip_for_outbound_sockets=127.2.55.129
--tserver_master_addrs=127.2.55.190:35553
--webserver_port=38765
--webserver_interface=127.2.55.129
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:50:08.569594 24848 log.cc:824] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:08.571589 24848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:50:08.571971 24848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824: Bootstrap complete.
I20260811 16:50:08.574483 24848 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } }
I20260811 16:50:08.574712 24848 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4aa972f4ad084985b7bea20f0fadc824, State: Initialized, Role: FOLLOWER
I20260811 16:50:08.574894 24848 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } }
I20260811 16:50:08.574955 24848 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:50:08.575011 24848 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:50:08.575060 24848 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:50:08.576092 24848 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } }
I20260811 16:50:08.576218 24848 leader_election.cc:302] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4aa972f4ad084985b7bea20f0fadc824; no voters:
I20260811 16:50:08.576432 24848 leader_election.cc:288] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 16:50:08.576468 24856 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:50:08.576643 24856 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 2 LEADER]: Becoming Leader. State: Replica: 4aa972f4ad084985b7bea20f0fadc824, State: Running, Role: LEADER
I20260811 16:50:08.576719 24848 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:50:08.576892 24856 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } }
I20260811 16:50:08.577237 24860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4aa972f4ad084985b7bea20f0fadc824" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } } }
I20260811 16:50:08.577349 24860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [sys.catalog]: This master's current role is: LEADER
I20260811 16:50:08.577239 24856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4aa972f4ad084985b7bea20f0fadc824. Latest consensus state: current_term: 2 leader_uuid: "4aa972f4ad084985b7bea20f0fadc824" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } } }
I20260811 16:50:08.577641 24856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [sys.catalog]: This master's current role is: LEADER
I20260811 16:50:08.577955 24869 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:50:08.578773 24869 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:50:08.578881 24869 catalog_manager.cc:1259] Loaded cluster ID: e90854db0b3a42cd8e62e65b5629986b
I20260811 16:50:08.578913 24869 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:50:08.579141 24869 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 16:50:08.583880 24869 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 16:50:08.586367 24869 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:50:08.586583 24869 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824: Loaded TSK: 0
I20260811 16:50:08.586861 24869 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 16:50:08.662989 24854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:08.663329 24854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:08.663376 24854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:08.665616 24854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:08.665683 24854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:08.665735 24854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:50:08.668457 24854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:43603
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=38765
--tserver_master_addrs=127.2.55.190:35553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:08.668732 24854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:08.669078 24854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:08.674826 24892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:08.674926 24890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:08.674850 24894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:08.675145 24854 server_base.cc:1034] running on GCE node
I20260811 16:50:08.675385 24854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:08.675663 24854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:08.676906 24854 hybrid_clock.cc:648] HybridClock initialized: now 1786467008676875 us; error 47 us; skew 500 ppm
Aug 11 16:50:08 dist-test-slave-3h5h krb5kdc[23850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467008, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:08.680713 24854 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:50:08.681305 24854 webserver.cc:460] Webserver started at http://127.2.55.129:38765/ using document root <none> and password file <none>
I20260811 16:50:08.681607 24854 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:08.681700 24854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:08.683598 24854 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:50:08.684489 24905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:08.684696 24854 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:50:08.684789 24854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "d031912b02c4474f9b40d35ded798eb9"
format_stamp: "Formatted at 2026-08-11 16:50:07 on dist-test-slave-3h5h"
server_key: "57d21629271b2fe0d4d72b0769f6a541"
server_key_iv: "5034a268f921404234cd84311ac0279f"
server_key_version: "encryptionkey@0"
I20260811 16:50:08.685325 24854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:08.694797 24854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:08.697587 24854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:08.697794 24854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:08.698060 24854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:50:08.698578 24913 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 16:50:08.700942 24854 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 16:50:08.701002 24854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260811 16:50:08.701038 24854 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 16:50:08.701927 24854 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 16:50:08.701977 24854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 16:50:08.702179 24913 tablet_bootstrap.cc:492] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9: Bootstrap starting.
I20260811 16:50:08.709259 24854 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:43603
I20260811 16:50:08.709738 24854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:50:08.713282 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 24854
I20260811 16:50:08.713626 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:41455
--local_ip_for_outbound_sockets=127.2.55.130
--tserver_master_addrs=127.2.55.190:35553
--webserver_port=45629
--webserver_interface=127.2.55.130
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:50:08.717073 24913 log.cc:824] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:08.717460 25077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:43603 every 8 connection(s)
I20260811 16:50:08.719816 24913 tablet_bootstrap.cc:492] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:50:08.720268 24913 tablet_bootstrap.cc:492] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9: Bootstrap complete.
I20260811 16:50:08.721719 24913 ts_tablet_manager.cc:1397] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.014s
Aug 11 16:50:08 dist-test-slave-3h5h krb5kdc[23850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467008, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:08.723064 24913 raft_consensus.cc:348] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } }
I20260811 16:50:08.723510 24913 raft_consensus.cc:729] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d031912b02c4474f9b40d35ded798eb9, State: Initialized, Role: FOLLOWER
I20260811 16:50:08.723759 24913 consensus_queue.cc:260] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } }
I20260811 16:50:08.724140 24913 ts_tablet_manager.cc:1428] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 16:50:08.727522 25083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.710506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:37437)
0811 16:50:08.710698 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:08.710745 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:08.711322 (+ 577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:08.714530 (+ 3208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:08.714536 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:08.714962 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:08.715318 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.715329 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.718508 (+ 3179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.718510 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.719710 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.719713 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.720490 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.720491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.720637 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.721301 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:08.721311 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:08.723152 (+ 1841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:08.725537 (+ 2385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:08.725546 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:08.725548 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:08.725883 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:08.726194 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:08.726195 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:08.726196 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:08.726325 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:08.726832 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:08.726839 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:08.726993 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 16:50:08.727101 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 16:50:08.727284 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":107,"threads_started":1}
I20260811 16:50:08.728850 25084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.710875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:37437 (local address 127.2.55.190:35553)
0811 16:50:08.714018 (+ 3143us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:08.714029 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:08.714081 (+ 52us) server_negotiation.cc:407] Connection header received
0811 16:50:08.714233 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:08.714240 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:08.714301 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:08.714459 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:08.716966 (+ 2507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.718391 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.719801 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.720387 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.720493 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.723302 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:08.723307 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:08.723307 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:08.723321 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:08.725430 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:08.725983 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:08.725986 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:08.725987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:08.726118 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:08.726398 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:08.726399 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:08.726400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:08.726718 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:08.726791 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:08.728443 (+ 1652us) server_negotiation.cc:299] Negotiation successful
0811 16:50:08.728603 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3065,"thread_start_us":75,"threads_started":1}
I20260811 16:50:08.729895 25079 heartbeater.cc:347] Connected to a master server at 127.2.55.190:35553
I20260811 16:50:08.730000 25079 heartbeater.cc:464] Registering TS with master...
I20260811 16:50:08.730199 25079 heartbeater.cc:511] Master 127.2.55.190:35553 requested a full tablet report, sending...
I20260811 16:50:08.731005 24786 ts_manager.cc:194] Registered new tserver with Master: d031912b02c4474f9b40d35ded798eb9 (127.2.55.129:43603)
I20260811 16:50:08.732205 24786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:37437
I20260811 16:50:08.733218 25079 heartbeater.cc:503] Master 127.2.55.190:35553 was elected leader, sending a full tablet report...
Aug 11 16:50:08 dist-test-slave-3h5h krb5kdc[23850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467008, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for kudu/127.2.55.129@KRBTEST.COM
I20260811 16:50:08.740448 25091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.731619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:43603 (local address 127.0.0.1:53850)
0811 16:50:08.732084 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:08.732120 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:08.732234 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:08.732718 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:08.732721 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:08.733074 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:08.733131 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.733134 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.734124 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.734125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.734806 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.734809 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.735280 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.735280 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.735358 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.735865 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:08.735871 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:08.737189 (+ 1318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:08.739257 (+ 2068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:08.739264 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:08.739266 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:08.739469 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:08.739700 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:08.739701 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:08.739702 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:08.739769 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:08.740066 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:08.740072 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:08.740125 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 16:50:08.740229 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 16:50:08.740353 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":101,"threads_started":1}
I20260811 16:50:08.740447 25093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.731876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53850 (local address 127.2.55.129:43603)
0811 16:50:08.732013 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:08.732017 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:08.732193 (+ 176us) server_negotiation.cc:407] Connection header received
0811 16:50:08.732342 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:08.732345 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:08.732360 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:08.732402 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:08.733250 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.733958 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.734906 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.735195 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.735279 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.737283 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:08.737292 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:08.737292 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:08.737299 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:08.739152 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:08.739557 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:08.739560 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:08.739561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:08.739629 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:08.739836 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:08.739837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:08.739838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:08.739985 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:08.740077 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:08.740268 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 16:50:08.740357 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":67,"threads_started":1}
I20260811 16:50:08.741045 24969 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c657199eafd4fd19780e3149994970e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:50:08 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:53850
I20260811 16:50:08.741557 25094 tablet_replica.cc:330] stopping tablet replica
I20260811 16:50:08.741730 25094 raft_consensus.cc:2229] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:50:08.741809 25094 raft_consensus.cc:2258] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:50:08.742121 25094 ts_tablet_manager.cc:1905] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:50:08.744298 25094 ts_tablet_manager.cc:1918] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:50:08.744395 25094 log.cc:1196] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal/wals/5c657199eafd4fd19780e3149994970e
I20260811 16:50:08.744655 25094 ts_tablet_manager.cc:1939] T 5c657199eafd4fd19780e3149994970e P d031912b02c4474f9b40d35ded798eb9: Deleting consensus metadata
I20260811 16:50:08.745256 24767 catalog_manager.cc:4841] TS d031912b02c4474f9b40d35ded798eb9 (127.2.55.129:43603): tablet 5c657199eafd4fd19780e3149994970e (table test-table [id=dbab770973ca4b27a888bd596bf86ff0]) successfully deleted
W20260811 16:50:08.833029 25086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:08.833274 25086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:08.833300 25086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:08.834457 25086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:08.834494 25086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:08.834520 25086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:50:08.835943 25086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:41455
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=45629
--tserver_master_addrs=127.2.55.190:35553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:08.836148 25086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:08.836344 25086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:08.842420 25101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:08.842430 25104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:08.842465 25086 server_base.cc:1034] running on GCE node
W20260811 16:50:08.842428 25100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:08.842999 25086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:08.843245 25086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:08.844401 25086 hybrid_clock.cc:648] HybridClock initialized: now 1786467008844353 us; error 66 us; skew 500 ppm
Aug 11 16:50:08 dist-test-slave-3h5h krb5kdc[23850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467008, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:08.847282 25086 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:50:08.847831 25086 webserver.cc:460] Webserver started at http://127.2.55.130:45629/ using document root <none> and password file <none>
I20260811 16:50:08.848099 25086 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:08.848191 25086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:08.850284 25086 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:08.850970 25115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:08.851167 25086 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:08.851284 25086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "18c06a4fd16a43f4a88844af44dfb944"
format_stamp: "Formatted at 2026-08-11 16:50:08 on dist-test-slave-3h5h"
server_key: "95b84dea70c0fc24beb83eed7555c5c4"
server_key_iv: "6f3663f93815561001daffb2b81067c3"
server_key_version: "encryptionkey@0"
I20260811 16:50:08.851665 25086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:08.866997 25086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:08.869123 25086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:08.869299 25086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:08.869554 25086 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:50:08.869897 25086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:50:08.869957 25086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:08.870003 25086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:50:08.870033 25086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:08.876652 25086 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:41455
I20260811 16:50:08.876713 25302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:41455 every 8 connection(s)
I20260811 16:50:08.877224 25086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:50:08 dist-test-slave-3h5h krb5kdc[23850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467008, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:08.886826 25084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.878102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:42545 (local address 127.2.55.190:35553)
0811 16:50:08.878178 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:08.878181 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:08.878394 (+ 213us) server_negotiation.cc:407] Connection header received
0811 16:50:08.878944 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:08.878945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:08.878960 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:08.879017 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:08.879980 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.880484 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.881563 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.881777 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.881834 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.884079 (+ 2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:08.884081 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:08.884081 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:08.884090 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:08.885619 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:08.885988 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:08.885989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:08.885989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:08.886045 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:08.886276 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:08.886277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:08.886277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:08.886384 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:08.886436 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:08.886676 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 16:50:08.886754 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 16:50:08.887184 25306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:08.878093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:42545)
0811 16:50:08.878256 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:08.878295 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:08.878851 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:08.879070 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:08.879074 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:08.879667 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:08.879893 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.879898 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.880572 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.880573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.881464 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:08.881467 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:08.881857 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:08.881858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:08.881971 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:08.882463 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:08.882471 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:08.883981 (+ 1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:08.885697 (+ 1716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:08.885703 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:08.885705 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:08.885921 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:08.886106 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:08.886107 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:08.886107 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:08.886219 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:08.886440 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:08.886445 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:08.886565 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 16:50:08.886649 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 16:50:08.886794 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":99,"threads_started":1}
I20260811 16:50:08.887444 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 25086
I20260811 16:50:08.887732 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:39571
--local_ip_for_outbound_sockets=127.2.55.131
--tserver_master_addrs=127.2.55.190:35553
--webserver_port=43655
--webserver_interface=127.2.55.131
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:50:08.888083 25303 heartbeater.cc:347] Connected to a master server at 127.2.55.190:35553
I20260811 16:50:08.888204 25303 heartbeater.cc:464] Registering TS with master...
I20260811 16:50:08.888419 25303 heartbeater.cc:511] Master 127.2.55.190:35553 requested a full tablet report, sending...
I20260811 16:50:08.888907 24786 ts_manager.cc:194] Registered new tserver with Master: 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455)
I20260811 16:50:08.889302 24786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:42545
W20260811 16:50:08.974041 25307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:08.974270 25307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:08.974296 25307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:08.975522 25307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:08.975569 25307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:08.975625 25307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:50:08.977470 25307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:39571
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=43655
--tserver_master_addrs=127.2.55.190:35553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:08.977737 25307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:08.978018 25307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:08.983459 25320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:08.983440 25319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:08.983461 25322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:08.983927 25307 server_base.cc:1034] running on GCE node
I20260811 16:50:08.984136 25307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:08.984354 25307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:08.985492 25307 hybrid_clock.cc:648] HybridClock initialized: now 1786467008985479 us; error 28 us; skew 500 ppm
Aug 11 16:50:08 dist-test-slave-3h5h krb5kdc[23850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467008, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:08.988126 25307 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:50:08.988643 25307 webserver.cc:460] Webserver started at http://127.2.55.131:43655/ using document root <none> and password file <none>
I20260811 16:50:08.988969 25307 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:08.989055 25307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:08.990572 25307 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:08.991231 25335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:08.991458 25307 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:08.991572 25307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "1a179660b61946a9b0b79cac74f427d3"
format_stamp: "Formatted at 2026-08-11 16:50:08 on dist-test-slave-3h5h"
server_key: "5c223c480d4b9c9203c18207de84cf44"
server_key_iv: "b71575f24ee2d7b43cd917c79c8559cd"
server_key_version: "encryptionkey@0"
I20260811 16:50:08.991933 25307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:09.014777 25307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:09.017396 25307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:09.017580 25307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:09.017844 25307 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:50:09.018189 25307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:50:09.018245 25307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:09.018292 25307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:50:09.018323 25307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:09.025038 25307 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:39571
I20260811 16:50:09.025080 25503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:39571 every 8 connection(s)
I20260811 16:50:09.025468 25307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:50:09 dist-test-slave-3h5h krb5kdc[23850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467008, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:09.034883 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 25307
I20260811 16:50:09.035480 25084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.026222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:48121 (local address 127.2.55.190:35553)
0811 16:50:09.026317 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:09.026319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:09.026486 (+ 167us) server_negotiation.cc:407] Connection header received
0811 16:50:09.027061 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:09.027063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:09.027077 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:09.027155 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:09.028234 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.028749 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.029841 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.030041 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.030104 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:09.032413 (+ 2309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:09.032415 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:09.032415 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:09.032431 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:09.033916 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:09.034403 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:09.034405 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:09.034405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:09.034471 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:09.034725 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:09.034727 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:09.034727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:09.034892 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:09.034976 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:09.035292 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 16:50:09.035386 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 16:50:09.035718 25507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.026146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:48121)
0811 16:50:09.026363 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:09.026409 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:09.026922 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:09.027235 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:09.027239 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:09.027852 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:09.028058 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:09.028064 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.028904 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.028905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:09.029745 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:09.029748 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.030125 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.030126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:09.030235 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:09.030823 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:09.030832 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:09.032293 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:09.034010 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:09.034019 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:09.034022 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:09.034314 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:09.034541 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:09.034542 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:09.034542 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:09.034648 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:09.034989 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:09.034996 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:09.035136 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 16:50:09.035258 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 16:50:09.035433 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":92,"threads_started":1}
I20260811 16:50:09.036285 25504 heartbeater.cc:347] Connected to a master server at 127.2.55.190:35553
I20260811 16:50:09.036382 25504 heartbeater.cc:464] Registering TS with master...
I20260811 16:50:09.036584 25504 heartbeater.cc:511] Master 127.2.55.190:35553 requested a full tablet report, sending...
I20260811 16:50:09.036993 24786 ts_manager.cc:194] Registered new tserver with Master: 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131:39571)
I20260811 16:50:09.037376 24786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:48121
I20260811 16:50:09.042762 25509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.035340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51156 (local address 127.2.55.190:35553)
0811 16:50:09.035467 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:09.035469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:09.035792 (+ 323us) server_negotiation.cc:407] Connection header received
0811 16:50:09.035819 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:09.035820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:09.035834 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:09.035909 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:09.036796 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.037493 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.038390 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.038594 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.038691 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:09.039807 (+ 1116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:09.039808 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:09.039809 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:09.039816 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:09.041710 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:09.042026 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:09.042027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:09.042027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:09.042085 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:09.042249 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:09.042250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:09.042250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:09.042346 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:09.042472 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:09.042527 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 16:50:09.042596 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":66,"threads_started":1}
I20260811 16:50:09.043717 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:50:09.047005 25509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.044080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51166 (local address 127.2.55.190:35553)
0811 16:50:09.044143 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:09.044146 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:09.044273 (+ 127us) server_negotiation.cc:407] Connection header received
0811 16:50:09.044368 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:09.044369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:09.044409 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:09.044503 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:50:09.044611 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.045199 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.046083 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.046304 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.046423 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:09.046620 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:50:09.046736 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:50:09.046847 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:09.046889 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 16:50:09.046917 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 16:50:09.047340 24786 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:51166:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:50:09.049129 24786 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:50:09.051551 24969 tablet_service.cc:1467] Processing CreateTablet for tablet f5ad26421ff9482abde0ad0b9b239372 (DEFAULT_TABLE table=test-table [id=a369607d6a9e41d0a0b5a5e0a8da93b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:50:09.051781 24969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5ad26421ff9482abde0ad0b9b239372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:09.053391 24913 tablet_bootstrap.cc:492] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9: Bootstrap starting.
I20260811 16:50:09.053717 24913 tablet_bootstrap.cc:654] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:09.054687 24913 tablet_bootstrap.cc:492] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9: No bootstrap required, opened a new log
I20260811 16:50:09.054768 24913 ts_tablet_manager.cc:1397] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:50:09.054929 24913 raft_consensus.cc:348] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } }
I20260811 16:50:09.055015 24913 raft_consensus.cc:374] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:09.055083 24913 raft_consensus.cc:729] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d031912b02c4474f9b40d35ded798eb9, State: Initialized, Role: FOLLOWER
I20260811 16:50:09.055132 24913 consensus_queue.cc:260] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } }
I20260811 16:50:09.055236 24913 ts_tablet_manager.cc:1428] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:09.056123 25091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.051156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:39571 (local address 127.0.0.1:58214)
0811 16:50:09.051209 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:09.051220 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:09.051260 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:09.051815 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:09.051816 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:09.051818 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:09.051876 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:09.051878 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.053336 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.053337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:09.054595 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:09.054619 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.055835 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.055835 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:09.055902 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:09.055923 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 16:50:09.056000 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 16:50:09.056051 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 16:50:09.056152 25513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.051409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58214 (local address 127.2.55.131:39571)
0811 16:50:09.051604 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:09.051610 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:09.051620 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:50:09.051664 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:09.051666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:09.051700 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:09.051788 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:09.051969 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.053217 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.054715 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.055655 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.055776 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:09.055851 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:09.056033 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 16:50:09.056073 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":107,"threads_started":1}
I20260811 16:50:09.057037 25512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.051277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:41455 (local address 127.0.0.1:44366)
0811 16:50:09.051394 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:09.051403 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:09.051443 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:09.051892 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:09.051893 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:09.051896 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:09.051958 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:09.051960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.054732 (+ 2772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.054733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:09.055748 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:09.055751 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.056761 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.056762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:09.056825 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:09.056855 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 16:50:09.056914 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:50:09.056955 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":68,"threads_started":1}
I20260811 16:50:09.057065 25515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.051506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44366 (local address 127.2.55.130:41455)
0811 16:50:09.051674 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:09.051678 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:09.051689 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:50:09.051735 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:09.051736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:09.051748 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:09.051889 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:09.052102 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.053237 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.055855 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.056665 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.056761 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:09.056822 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:09.056928 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 16:50:09.056976 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":91,"threads_started":1}
I20260811 16:50:09.056986 25391 tablet_service.cc:1467] Processing CreateTablet for tablet f5ad26421ff9482abde0ad0b9b239372 (DEFAULT_TABLE table=test-table [id=a369607d6a9e41d0a0b5a5e0a8da93b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:50:09.057381 25391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5ad26421ff9482abde0ad0b9b239372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:09.057761 25204 tablet_service.cc:1467] Processing CreateTablet for tablet f5ad26421ff9482abde0ad0b9b239372 (DEFAULT_TABLE table=test-table [id=a369607d6a9e41d0a0b5a5e0a8da93b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:50:09.058081 25204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5ad26421ff9482abde0ad0b9b239372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:09.060523 25518 tablet_bootstrap.cc:492] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3: Bootstrap starting.
I20260811 16:50:09.061010 25519 tablet_bootstrap.cc:492] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944: Bootstrap starting.
I20260811 16:50:09.061283 25518 tablet_bootstrap.cc:654] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:09.061632 25519 tablet_bootstrap.cc:654] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:09.061857 25518 log.cc:824] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:09.062163 25519 log.cc:824] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:09.062654 25518 tablet_bootstrap.cc:492] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3: No bootstrap required, opened a new log
I20260811 16:50:09.062728 25518 ts_tablet_manager.cc:1397] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 16:50:09.062966 25519 tablet_bootstrap.cc:492] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944: No bootstrap required, opened a new log
I20260811 16:50:09.063045 25519 ts_tablet_manager.cc:1397] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:50:09.064344 25518 raft_consensus.cc:348] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } }
I20260811 16:50:09.064488 25518 raft_consensus.cc:374] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:09.064512 25518 raft_consensus.cc:729] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a179660b61946a9b0b79cac74f427d3, State: Initialized, Role: FOLLOWER
I20260811 16:50:09.064649 25518 consensus_queue.cc:260] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } }
I20260811 16:50:09.064654 25519 raft_consensus.cc:348] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } }
I20260811 16:50:09.064900 25519 raft_consensus.cc:374] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:09.064977 25519 raft_consensus.cc:729] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c06a4fd16a43f4a88844af44dfb944, State: Initialized, Role: FOLLOWER
I20260811 16:50:09.064977 25518 ts_tablet_manager.cc:1428] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 16:50:09.064998 25504 heartbeater.cc:503] Master 127.2.55.190:35553 was elected leader, sending a full tablet report...
I20260811 16:50:09.065114 25519 consensus_queue.cc:260] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } }
I20260811 16:50:09.065424 25519 ts_tablet_manager.cc:1428] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:50:09.065452 25303 heartbeater.cc:503] Master 127.2.55.190:35553 was elected leader, sending a full tablet report...
W20260811 16:50:09.127858 25304 tablet.cc:2369] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:50:09.213466 25080 tablet.cc:2369] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:50:09.254899 25525 raft_consensus.cc:482] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:50:09.255056 25525 raft_consensus.cc:504] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } }
I20260811 16:50:09.255515 25525 leader_election.cc:288] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455), d031912b02c4474f9b40d35ded798eb9 (127.2.55.129:43603)
I20260811 16:50:09.259763 25528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.255894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:46699 (local address 127.2.55.129:43603)
0811 16:50:09.256030 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:09.256032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:09.256042 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:50:09.256071 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:09.256072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:09.256103 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:09.256227 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:09.256346 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.257077 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.258742 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.259377 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.259446 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:09.259528 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:09.259639 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 16:50:09.259684 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":69,"threads_started":1}
I20260811 16:50:09.259765 25515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.255838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:38247 (local address 127.2.55.130:41455)
0811 16:50:09.255892 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:09.255894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:09.255909 (+ 15us) server_negotiation.cc:407] Connection header received
0811 16:50:09.255944 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:09.255946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:09.255958 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:09.256050 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:09.256247 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.257056 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.258738 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.259341 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.259429 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:09.259440 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:09.259637 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 16:50:09.259707 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:50:09.259759 25507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.255753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:41455 (local address 127.2.55.131:38247)
0811 16:50:09.255817 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:09.255831 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:09.255880 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:09.256063 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:09.256064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:09.256066 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:09.256137 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:09.256139 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.257172 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.257173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:09.258629 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:09.258634 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.259453 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.259454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:09.259546 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:09.259553 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 16:50:09.259613 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 16:50:09.259665 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":137}
I20260811 16:50:09.259766 25527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.255753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:43603 (local address 127.2.55.131:46699)
0811 16:50:09.255938 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:09.255948 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:09.255994 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:09.256205 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:09.256206 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:09.256208 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:09.256272 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:09.256273 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.257172 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.257173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:09.258629 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:09.258634 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.259457 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.259458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:09.259546 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:09.259553 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 16:50:09.259613 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 16:50:09.259665 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":84,"thread_start_us":102,"threads_started":1}
I20260811 16:50:09.260226 25240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5ad26421ff9482abde0ad0b9b239372" candidate_uuid: "1a179660b61946a9b0b79cac74f427d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c06a4fd16a43f4a88844af44dfb944" is_pre_election: true
I20260811 16:50:09.260304 25005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5ad26421ff9482abde0ad0b9b239372" candidate_uuid: "1a179660b61946a9b0b79cac74f427d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d031912b02c4474f9b40d35ded798eb9" is_pre_election: true
I20260811 16:50:09.260380 25240 raft_consensus.cc:2454] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a179660b61946a9b0b79cac74f427d3 in term 0.
I20260811 16:50:09.260514 25005 raft_consensus.cc:2454] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a179660b61946a9b0b79cac74f427d3 in term 0.
I20260811 16:50:09.260710 25341 leader_election.cc:302] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c06a4fd16a43f4a88844af44dfb944, 1a179660b61946a9b0b79cac74f427d3; no voters:
I20260811 16:50:09.260875 25525 raft_consensus.cc:2781] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:50:09.260937 25525 raft_consensus.cc:482] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:50:09.260962 25525 raft_consensus.cc:3037] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:09.261678 25525 raft_consensus.cc:504] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } }
I20260811 16:50:09.261837 25525 leader_election.cc:288] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [CANDIDATE]: Term 1 election: Requested vote from peers 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455), d031912b02c4474f9b40d35ded798eb9 (127.2.55.129:43603)
I20260811 16:50:09.262017 25240 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5ad26421ff9482abde0ad0b9b239372" candidate_uuid: "1a179660b61946a9b0b79cac74f427d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c06a4fd16a43f4a88844af44dfb944"
I20260811 16:50:09.262058 25005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5ad26421ff9482abde0ad0b9b239372" candidate_uuid: "1a179660b61946a9b0b79cac74f427d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d031912b02c4474f9b40d35ded798eb9"
I20260811 16:50:09.262109 25240 raft_consensus.cc:3037] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:09.262153 25005 raft_consensus.cc:3037] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:09.262816 25005 raft_consensus.cc:2454] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a179660b61946a9b0b79cac74f427d3 in term 1.
I20260811 16:50:09.262885 25240 raft_consensus.cc:2454] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a179660b61946a9b0b79cac74f427d3 in term 1.
I20260811 16:50:09.263056 25337 leader_election.cc:302] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a179660b61946a9b0b79cac74f427d3, d031912b02c4474f9b40d35ded798eb9; no voters:
I20260811 16:50:09.263149 25525 raft_consensus.cc:2781] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:50:09.263298 25525 raft_consensus.cc:686] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [term 1 LEADER]: Becoming Leader. State: Replica: 1a179660b61946a9b0b79cac74f427d3, State: Running, Role: LEADER
I20260811 16:50:09.263409 25525 consensus_queue.cc:237] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } }
I20260811 16:50:09.264380 24786 catalog_manager.cc:5495] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131). New cstate: current_term: 1 leader_uuid: "1a179660b61946a9b0b79cac74f427d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } health_report { overall_health: UNKNOWN } } }
W20260811 16:50:09.276028 25505 tablet.cc:2369] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:50:09.283152 25513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.281042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58226 (local address 127.2.55.131:39571)
0811 16:50:09.281087 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:09.281089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:09.281108 (+ 19us) server_negotiation.cc:407] Connection header received
0811 16:50:09.281175 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:09.281176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:09.281199 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:09.281266 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:50:09.281367 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.281830 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.282508 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:09.282699 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:09.282753 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:09.282873 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:50:09.282969 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:50:09.283024 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:09.283058 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 16:50:09.283073 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:50:09.285106 25005 raft_consensus.cc:1261] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Refusing update from remote peer 1a179660b61946a9b0b79cac74f427d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:50:09.285106 25240 raft_consensus.cc:1261] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944 [term 1 FOLLOWER]: Refusing update from remote peer 1a179660b61946a9b0b79cac74f427d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:50:09.285470 25529 consensus_queue.cc:1035] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:50:09.285586 25525 consensus_queue.cc:1035] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:50:09.287710 25534 mvcc.cc:205] Tried to move back new op lower bound from 7317368870028767232 to 7317368869943910400. Current Snapshot: MvccSnapshot[applied={T|T < 7317368870028767232}]
I20260811 16:50:09.288348 25536 mvcc.cc:205] Tried to move back new op lower bound from 7317368870028767232 to 7317368869943910400. Current Snapshot: MvccSnapshot[applied={T|T < 7317368870028767232}]
I20260811 16:50:09.288908 25540 mvcc.cc:205] Tried to move back new op lower bound from 7317368870028767232 to 7317368869943910400. Current Snapshot: MvccSnapshot[applied={T|T < 7317368870028767232 or (T in {7317368870028767232})}]
I20260811 16:50:09.290493 24786 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:51166:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:50:09.290607 24786 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:51166:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:50:09.291378 24786 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824: Sending DeleteTablet for 3 replicas of tablet f5ad26421ff9482abde0ad0b9b239372
I20260811 16:50:09.291725 25204 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ad26421ff9482abde0ad0b9b239372 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:50:09 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:44366
I20260811 16:50:09.291749 25391 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ad26421ff9482abde0ad0b9b239372 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:50:09 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:58214
I20260811 16:50:09.291961 25549 tablet_replica.cc:330] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944: stopping tablet replica
I20260811 16:50:09.292002 24969 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ad26421ff9482abde0ad0b9b239372 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:50:09 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:53850
I20260811 16:50:09.292119 25549 raft_consensus.cc:2229] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:50:09.292148 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 24854
I20260811 16:50:09.296445 25549 raft_consensus.cc:2258] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:50:09.305884 25550 tablet_replica.cc:330] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3: stopping tablet replica
I20260811 16:50:09.306123 25550 raft_consensus.cc:2229] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:50:09.306305 25550 raft_consensus.cc:2258] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:50:09.307646 25550 ts_tablet_manager.cc:1905] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:50:09.308024 25549 ts_tablet_manager.cc:1905] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:50:09.309640 25550 ts_tablet_manager.cc:1918] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:50:09.309734 25550 log.cc:1196] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/f5ad26421ff9482abde0ad0b9b239372
I20260811 16:50:09.309814 25549 ts_tablet_manager.cc:1918] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:50:09.309897 25549 log.cc:1196] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/f5ad26421ff9482abde0ad0b9b239372
I20260811 16:50:09.310098 25550 ts_tablet_manager.cc:1939] T f5ad26421ff9482abde0ad0b9b239372 P 1a179660b61946a9b0b79cac74f427d3: Deleting consensus metadata
I20260811 16:50:09.310209 25549 ts_tablet_manager.cc:1939] T f5ad26421ff9482abde0ad0b9b239372 P 18c06a4fd16a43f4a88844af44dfb944: Deleting consensus metadata
I20260811 16:50:09.310678 24768 catalog_manager.cc:4841] TS 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131:39571): tablet f5ad26421ff9482abde0ad0b9b239372 (table test-table [id=a369607d6a9e41d0a0b5a5e0a8da93b2]) successfully deleted
I20260811 16:50:09.310695 24769 catalog_manager.cc:4841] TS 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455): tablet f5ad26421ff9482abde0ad0b9b239372 (table test-table [id=a369607d6a9e41d0a0b5a5e0a8da93b2]) successfully deleted
W20260811 16:50:09.312561 24767 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.55.129:43603 (error 108)
I20260811 16:50:09.312894 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 25086
I20260811 16:50:09.313094 25512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.312960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:43603 (local address 127.0.0.1:55522)
0811 16:50:09.313017 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:09.313054 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:43603: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 16:50:09.333756 24767 catalog_manager.cc:4584] TS d031912b02c4474f9b40d35ded798eb9 (127.2.55.129:43603): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f5ad26421ff9482abde0ad0b9b239372: Network error: Client connection negotiation failed: client connection to 127.2.55.129:43603: connect: Connection refused (error 111)
I20260811 16:50:09.340548 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 25307
I20260811 16:50:09.357666 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 24742
I20260811 16:50:09.367997 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:35553
--webserver_interface=127.2.55.190
--webserver_port=33739
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:35553
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:50:09.453073 25554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:09.453297 25554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:09.453320 25554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:09.454545 25554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:50:09.454591 25554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:09.454607 25554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:09.454659 25554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:50:09.454677 25554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:50:09.456215 25554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:35553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:35553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=33739
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:09.456483 25554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:09.456734 25554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:09.461812 25569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:09.461822 25570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:09.461831 25574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:09.461861 25554 server_base.cc:1034] running on GCE node
I20260811 16:50:09.462246 25554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:09.462570 25554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:09.463725 25554 hybrid_clock.cc:648] HybridClock initialized: now 1786467009463712 us; error 46 us; skew 500 ppm
Aug 11 16:50:09 dist-test-slave-3h5h krb5kdc[23850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467009, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:09.466408 25554 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:50:09.466934 25554 webserver.cc:460] Webserver started at http://127.2.55.190:33739/ using document root <none> and password file <none>
I20260811 16:50:09.467211 25554 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:09.467285 25554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:09.468683 25554 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:09.469456 25585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:09.469725 25554 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:50:09.469844 25554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "4aa972f4ad084985b7bea20f0fadc824"
format_stamp: "Formatted at 2026-08-11 16:50:07 on dist-test-slave-3h5h"
server_key: "15b73601a4b0538cd09980f21858bd87"
server_key_iv: "62d955641f755ec0e08e704d3303a8be"
server_key_version: "encryptionkey@0"
I20260811 16:50:09.470232 25554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:09.514305 25554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:09.516585 25554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:09.516806 25554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:09.521140 25554 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:35553
I20260811 16:50:09.521216 25656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:35553 every 8 connection(s)
I20260811 16:50:09.521615 25554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:50:09.523304 25657 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:50:09.524040 25657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824: Bootstrap starting.
I20260811 16:50:09.524042 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 25554
I20260811 16:50:09.524353 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:43603
--local_ip_for_outbound_sockets=127.2.55.129
--tserver_master_addrs=127.2.55.190:35553
--webserver_port=38765
--webserver_interface=127.2.55.129
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:50:09.533710 25657 log.cc:824] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:09.536015 25657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:50:09.536329 25657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824: Bootstrap complete.
I20260811 16:50:09.538769 25657 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } }
I20260811 16:50:09.539019 25657 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4aa972f4ad084985b7bea20f0fadc824, State: Initialized, Role: FOLLOWER
I20260811 16:50:09.539201 25657 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } }
I20260811 16:50:09.539281 25657 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:50:09.539337 25657 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:50:09.539386 25657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:50:09.540411 25657 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } }
I20260811 16:50:09.540535 25657 leader_election.cc:302] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4aa972f4ad084985b7bea20f0fadc824; no voters:
I20260811 16:50:09.540745 25657 leader_election.cc:288] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 16:50:09.540786 25662 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:50:09.540917 25662 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [term 3 LEADER]: Becoming Leader. State: Replica: 4aa972f4ad084985b7bea20f0fadc824, State: Running, Role: LEADER
I20260811 16:50:09.541055 25657 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:50:09.541085 25662 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } }
I20260811 16:50:09.541396 25662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4aa972f4ad084985b7bea20f0fadc824. Latest consensus state: current_term: 3 leader_uuid: "4aa972f4ad084985b7bea20f0fadc824" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } } }
I20260811 16:50:09.541401 25663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "4aa972f4ad084985b7bea20f0fadc824" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa972f4ad084985b7bea20f0fadc824" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 35553 } } }
I20260811 16:50:09.541594 25662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [sys.catalog]: This master's current role is: LEADER
I20260811 16:50:09.541604 25663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aa972f4ad084985b7bea20f0fadc824 [sys.catalog]: This master's current role is: LEADER
I20260811 16:50:09.541844 25674 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:50:09.542811 25674 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:50:09.543175 25674 catalog_manager.cc:1259] Loaded cluster ID: e90854db0b3a42cd8e62e65b5629986b
I20260811 16:50:09.543391 25674 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 16:50:09.543757 25674 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f9df0ee79ad google::LogMessage::Fail() at ??:0
@ 0x7f9df0eea88a google::LogMessage::SendToLog() at ??:0
@ 0x7f9df0ee74de google::LogMessage::Flush() at ??:0
@ 0x7f9df0ee8a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f9df8e080f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f9df8e118b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f9df2db50d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f9df2daa954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f9df3c0e6db start_thread at ??:0
@ 0x7f9def9e561f clone at ??:0
W20260811 16:50:09.627195 25660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:09.627425 25660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:09.627465 25660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:09.628607 25660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:09.628681 25660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:09.628728 25660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:50:09.630409 25660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:43603
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=38765
--tserver_master_addrs=127.2.55.190:35553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:09.630684 25660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:09.630926 25660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:09.636093 25719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:09.636112 25724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:09.636264 25660 server_base.cc:1034] running on GCE node
W20260811 16:50:09.636264 25720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:09.636580 25660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:09.636821 25660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:09.638002 25660 hybrid_clock.cc:648] HybridClock initialized: now 1786467009637966 us; error 51 us; skew 500 ppm
Aug 11 16:50:09 dist-test-slave-3h5h krb5kdc[23850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467009, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:09.640609 25660 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:50:09.641167 25660 webserver.cc:460] Webserver started at http://127.2.55.129:38765/ using document root <none> and password file <none>
I20260811 16:50:09.641407 25660 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:09.641453 25660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:09.642817 25660 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:09.643564 25734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:09.643810 25660 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:09.643914 25660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "d031912b02c4474f9b40d35ded798eb9"
format_stamp: "Formatted at 2026-08-11 16:50:07 on dist-test-slave-3h5h"
server_key: "57d21629271b2fe0d4d72b0769f6a541"
server_key_iv: "5034a268f921404234cd84311ac0279f"
server_key_version: "encryptionkey@0"
I20260811 16:50:09.644289 25660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:09.660465 25660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:09.662868 25660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:09.663045 25660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:09.663317 25660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:50:09.663785 25746 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 16:50:09.666059 25660 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 16:50:09.666141 25660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 16:50:09.666225 25660 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 16:50:09.666877 25660 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 16:50:09.666936 25660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 16:50:09.667008 25746 tablet_bootstrap.cc:492] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9: Bootstrap starting.
I20260811 16:50:09.674503 25660 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:43603
I20260811 16:50:09.674657 25905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:43603 every 8 connection(s)
I20260811 16:50:09.674948 25660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:50:09.678857 25746 log.cc:824] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:09.680714 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 25660
I20260811 16:50:09.681012 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:41455
--local_ip_for_outbound_sockets=127.2.55.130
--tserver_master_addrs=127.2.55.190:35553
--webserver_port=45629
--webserver_interface=127.2.55.130
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:50:09.681689 25746 tablet_bootstrap.cc:492] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:50:09.682062 25746 tablet_bootstrap.cc:492] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9: Bootstrap complete.
I20260811 16:50:09.683521 25746 ts_tablet_manager.cc:1397] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.011s
I20260811 16:50:09.685302 25746 raft_consensus.cc:348] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } }
I20260811 16:50:09.685760 25746 raft_consensus.cc:729] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d031912b02c4474f9b40d35ded798eb9, State: Initialized, Role: FOLLOWER
I20260811 16:50:09.685920 25746 consensus_queue.cc:260] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } }
I20260811 16:50:09.686218 25746 ts_tablet_manager.cc:1428] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9: Time spent starting tablet: real 0.003s user 0.005s sys 0.000s
W20260811 16:50:09.771266 25911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:09.771587 25911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:09.771632 25911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:09.774128 25911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:09.774204 25911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:09.774194 25908 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:50:09.675708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:46659)
0811 16:50:09.675945 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:09.675982 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:09.676420 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:09.773977 (+ 97557us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":136,"threads_started":1}
W20260811 16:50:09.774236 25911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
W20260811 16:50:09.774463 25906 heartbeater.cc:644] Failed to heartbeat to 127.2.55.190:35553 (0 consecutive failures): Network error: Failed to ping master at 127.2.55.190:35553: Client connection negotiation failed: client connection to 127.2.55.190:35553: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 16:50:09.774848 25908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.774720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:57889)
0811 16:50:09.774779 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:09.774826 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 16:50:09.775238 25908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.775134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:47275)
0811 16:50:09.775197 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:09.775222 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 16:50:09.775388 25906 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 16:50:09.776247 25911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:41455
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=45629
--tserver_master_addrs=127.2.55.190:35553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:09.776553 25911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:09.776829 25911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:09.782001 25930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:09.782143 25932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:09.782047 25929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:09.782243 25911 server_base.cc:1034] running on GCE node
I20260811 16:50:09.782506 25911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:09.782764 25911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:09.783928 25911 hybrid_clock.cc:648] HybridClock initialized: now 1786467009783913 us; error 44 us; skew 500 ppm
Aug 11 16:50:09 dist-test-slave-3h5h krb5kdc[23850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467009, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:09.786559 25911 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:50:09.787070 25911 webserver.cc:460] Webserver started at http://127.2.55.130:45629/ using document root <none> and password file <none>
I20260811 16:50:09.787324 25911 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:09.787402 25911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:09.788803 25911 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:09.789510 25944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:09.789685 25911 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:50:09.789795 25911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "18c06a4fd16a43f4a88844af44dfb944"
format_stamp: "Formatted at 2026-08-11 16:50:08 on dist-test-slave-3h5h"
server_key: "95b84dea70c0fc24beb83eed7555c5c4"
server_key_iv: "6f3663f93815561001daffb2b81067c3"
server_key_version: "encryptionkey@0"
I20260811 16:50:09.790150 25911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:09.803685 25911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:09.805833 25911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:09.806002 25911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:09.806263 25911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:50:09.806597 25911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:50:09.806658 25911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:09.806692 25911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:50:09.806741 25911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:09.813102 25911 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:41455
I20260811 16:50:09.813150 26117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:41455 every 8 connection(s)
I20260811 16:50:09.813509 25911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:50:09.814680 26121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.814301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:36415)
0811 16:50:09.814464 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:09.814533 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":80,"threads_started":1}
W20260811 16:50:09.815076 26118 heartbeater.cc:644] Failed to heartbeat to 127.2.55.190:35553 (0 consecutive failures): Network error: Failed to ping master at 127.2.55.190:35553: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
I20260811 16:50:09.815366 26121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.815270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:59809)
0811 16:50:09.815318 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:09.815347 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 16:50:09.815644 26121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.815594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:49089)
0811 16:50:09.815615 (+ 21us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:09.815633 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260811 16:50:09.815840 26118 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 16:50:09.817700 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 25911
I20260811 16:50:09.817999 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:39571
--local_ip_for_outbound_sockets=127.2.55.131
--tserver_master_addrs=127.2.55.190:35553
--webserver_port=43655
--webserver_interface=127.2.55.131
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:34933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:50:09.903215 26122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:09.903434 26122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:09.903458 26122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:09.904577 26122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:09.904614 26122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:09.904641 26122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:50:09.906123 26122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:34933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:39571
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=43655
--tserver_master_addrs=127.2.55.190:35553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:09.906322 26122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:09.906510 26122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:50:09.911933 26122 server_base.cc:1034] running on GCE node
W20260811 16:50:09.911916 26133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:09.911907 26132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:09.911916 26137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:09.912285 26122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:09.912494 26122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:09.913671 26122 hybrid_clock.cc:648] HybridClock initialized: now 1786467009913654 us; error 29 us; skew 500 ppm
Aug 11 16:50:09 dist-test-slave-3h5h krb5kdc[23850](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467009, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:09.916311 26122 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:50:09.916769 26122 webserver.cc:460] Webserver started at http://127.2.55.131:43655/ using document root <none> and password file <none>
I20260811 16:50:09.917028 26122 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:09.917109 26122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:09.918457 26122 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:09.919066 26150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:09.919240 26122 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:50:09.919348 26122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "1a179660b61946a9b0b79cac74f427d3"
format_stamp: "Formatted at 2026-08-11 16:50:08 on dist-test-slave-3h5h"
server_key: "5c223c480d4b9c9203c18207de84cf44"
server_key_iv: "b71575f24ee2d7b43cd917c79c8559cd"
server_key_version: "encryptionkey@0"
I20260811 16:50:09.919703 26122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:09.933301 26122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:09.936097 26122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:09.936285 26122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:09.936551 26122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:50:09.936980 26122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:50:09.937049 26122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:09.937098 26122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:50:09.937143 26122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:09.943852 26122 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:39571
I20260811 16:50:09.943892 26324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:39571 every 8 connection(s)
I20260811 16:50:09.944316 26122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:50:09.945547 26330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.945093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:41745)
0811 16:50:09.945266 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:09.945342 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":79,"threads_started":1}
W20260811 16:50:09.946012 26328 heartbeater.cc:644] Failed to heartbeat to 127.2.55.190:35553 (0 consecutive failures): Network error: Failed to ping master at 127.2.55.190:35553: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
I20260811 16:50:09.946477 26330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.946230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:51339)
0811 16:50:09.946414 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:09.946455 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
I20260811 16:50:09.946796 26330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:09.946693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:46049)
0811 16:50:09.946739 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:09.946779 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 16:50:09.946928 26328 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 16:50:09.954386 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 26122
I20260811 16:50:10.776016 26334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:10.775752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:35447)
0811 16:50:10.775903 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:10.775947 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":67,"threads_started":1}
I20260811 16:50:10.816385 26335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:10.816162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:50829)
0811 16:50:10.816299 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:10.816336 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":61,"threads_started":1}
I20260811 16:50:10.947461 26338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:10.947249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:54843)
0811 16:50:10.947370 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:10.947408 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
I20260811 16:50:11.339044 26339 raft_consensus.cc:482] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:50:11.339193 26339 raft_consensus.cc:504] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } }
I20260811 16:50:11.339524 26339 leader_election.cc:288] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131:39571), 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455)
Aug 11 16:50:11 dist-test-slave-3h5h krb5kdc[23850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467009, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.130@KRBTEST.COM
Aug 11 16:50:11 dist-test-slave-3h5h krb5kdc[23850](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467009, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.131@KRBTEST.COM
I20260811 16:50:11.350885 26341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:11.339742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:41455 (local address 127.2.55.129:57423)
0811 16:50:11.339968 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:11.339980 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:11.340042 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:11.340929 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:11.340932 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:11.341322 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:11.341525 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:11.341531 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:11.342627 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:11.342628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:11.343415 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:11.343417 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:11.344015 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:11.344016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:11.344132 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:11.344756 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:11.344765 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:11.346301 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:11.348787 (+ 2486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:11.348797 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:11.348800 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:11.349275 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:11.349587 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:11.349588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:11.349588 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:11.349750 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:11.350248 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:11.350256 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:11.350430 (+ 174us) client_negotiation.cc:769] Sending connection context
0811 16:50:11.350530 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 16:50:11.350760 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":28,"thread_start_us":75,"threads_started":1}
I20260811 16:50:11.350989 26343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:11.339728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:39571 (local address 127.2.55.129:52715)
0811 16:50:11.339893 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:11.339905 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:11.339971 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:11.340929 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:11.340932 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:11.341323 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:11.341525 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:11.341531 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:11.342638 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:11.342639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:11.343415 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:11.343418 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:11.344018 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:11.344020 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:11.344132 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:11.344795 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:11.344800 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:11.346685 (+ 1885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:11.348787 (+ 2102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:11.348797 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:11.348800 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:11.349275 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:11.349587 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:11.349588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:11.349588 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:11.349750 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:11.350248 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:11.350256 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:11.350418 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 16:50:11.350530 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 16:50:11.350866 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":255,"thread_start_us":49,"threads_started":1}
I20260811 16:50:11.351102 26346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:11.339942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:57423 (local address 127.2.55.130:41455)
0811 16:50:11.340084 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:11.340097 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:11.340130 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:50:11.340667 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:11.340670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:11.340715 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:11.340891 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:11.341648 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:11.342508 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:11.343510 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:11.343905 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:11.344050 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:11.346422 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:11.346428 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:11.346428 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:11.346444 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:11.348703 (+ 2259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:11.349369 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:11.349372 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:11.349373 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:11.349505 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:11.349840 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:11.349841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:11.349842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:11.350163 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:11.350254 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:11.350807 (+ 553us) server_negotiation.cc:299] Negotiation successful
0811 16:50:11.350936 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":58,"threads_started":1}
I20260811 16:50:11.351524 26344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:11.339872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:52715 (local address 127.2.55.131:39571)
0811 16:50:11.340124 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:11.340135 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:11.340175 (+ 40us) server_negotiation.cc:407] Connection header received
0811 16:50:11.340675 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:11.340677 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:11.340720 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:11.340901 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:11.341646 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:11.342508 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:11.343523 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:11.343915 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:11.344050 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:11.346817 (+ 2767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:11.346821 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:11.346821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:11.346831 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:11.348696 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:11.349369 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:11.349372 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:11.349373 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:11.349505 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:11.349840 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:11.349841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:11.349842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:11.350163 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:11.350254 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:11.351293 (+ 1039us) server_negotiation.cc:299] Negotiation successful
0811 16:50:11.351424 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":62,"threads_started":1}
W20260811 16:50:11.351876 25741 leader_election.cc:341] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455): Not found: Tablet not found: f5ad26421ff9482abde0ad0b9b239372
W20260811 16:50:11.352241 25740 leader_election.cc:341] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131:39571): Not found: Tablet not found: f5ad26421ff9482abde0ad0b9b239372
I20260811 16:50:11.352311 25740 leader_election.cc:302] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d031912b02c4474f9b40d35ded798eb9; no voters: 18c06a4fd16a43f4a88844af44dfb944, 1a179660b61946a9b0b79cac74f427d3
I20260811 16:50:11.352458 26339 raft_consensus.cc:2726] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:50:11.776665 26343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:11.776527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:44781)
0811 16:50:11.776585 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:11.776623 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 16:50:11.817106 26347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:11.816886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:39901)
0811 16:50:11.817013 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:11.817058 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
I20260811 16:50:11.948151 26348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:11.947926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:40353)
0811 16:50:11.948071 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:11.948109 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":58,"threads_started":1}
I20260811 16:50:12.777701 26349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:12.777393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:42845)
0811 16:50:12.777568 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:12.777616 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":96,"threads_started":1}
I20260811 16:50:12.817885 26350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:12.817631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:55735)
0811 16:50:12.817800 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:12.817839 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":104,"threads_started":1}
I20260811 16:50:12.948937 26351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:12.948640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:42927)
0811 16:50:12.948805 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:12.948890 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":105,"threads_started":1}
I20260811 16:50:13.093325 26352 raft_consensus.cc:482] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:50:13.093430 26352 raft_consensus.cc:504] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } }
I20260811 16:50:13.093837 26352 leader_election.cc:288] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131:39571), 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455)
W20260811 16:50:13.094189 25741 leader_election.cc:341] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455): Not found: Tablet not found: f5ad26421ff9482abde0ad0b9b239372
W20260811 16:50:13.094285 25740 leader_election.cc:341] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131:39571): Not found: Tablet not found: f5ad26421ff9482abde0ad0b9b239372
I20260811 16:50:13.094403 25740 leader_election.cc:302] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d031912b02c4474f9b40d35ded798eb9; no voters: 18c06a4fd16a43f4a88844af44dfb944, 1a179660b61946a9b0b79cac74f427d3
I20260811 16:50:13.094494 26352 raft_consensus.cc:2726] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:50:13.778488 26353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:13.778268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:60459)
0811 16:50:13.778406 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:13.778438 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":72,"threads_started":1}
I20260811 16:50:13.818671 26354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:13.818407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:52063)
0811 16:50:13.818572 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:13.818618 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":66,"threads_started":1}
I20260811 16:50:13.949707 26355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:13.949434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:52717)
0811 16:50:13.949583 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:13.949626 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":69,"threads_started":1}
I20260811 16:50:14.779531 26358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:14.779206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:60119)
0811 16:50:14.779430 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:14.779477 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":74,"threads_started":1}
I20260811 16:50:14.819639 26360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:14.819373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:37695)
0811 16:50:14.819543 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:14.819592 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":70,"threads_started":1}
I20260811 16:50:14.950433 26361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:14.950217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:37615)
0811 16:50:14.950342 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:14.950384 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260811 16:50:15.234619 26362 raft_consensus.cc:482] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:50:15.234754 26362 raft_consensus.cc:504] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } }
I20260811 16:50:15.234954 26362 leader_election.cc:288] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131:39571), 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455)
W20260811 16:50:15.235508 25741 leader_election.cc:341] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455): Not found: Tablet not found: f5ad26421ff9482abde0ad0b9b239372
W20260811 16:50:15.235570 25740 leader_election.cc:341] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131:39571): Not found: Tablet not found: f5ad26421ff9482abde0ad0b9b239372
I20260811 16:50:15.235607 25740 leader_election.cc:302] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d031912b02c4474f9b40d35ded798eb9; no voters: 18c06a4fd16a43f4a88844af44dfb944, 1a179660b61946a9b0b79cac74f427d3
I20260811 16:50:15.235692 26362 raft_consensus.cc:2726] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:50:15.780548 26364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:15.780218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:48533)
0811 16:50:15.780414 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:15.780491 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":93,"threads_started":1}
I20260811 16:50:15.820482 26365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:15.820242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:37473)
0811 16:50:15.820389 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:15.820431 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":76,"threads_started":1}
I20260811 16:50:15.951143 26366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:15.950896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:58845)
0811 16:50:15.951051 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:15.951091 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":86,"threads_started":1}
I20260811 16:50:16.781450 26371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:16.781158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:59671)
0811 16:50:16.781345 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:16.781397 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":75,"threads_started":1}
I20260811 16:50:16.821638 26373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:16.821381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:51431)
0811 16:50:16.821543 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:16.821590 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":75,"threads_started":1}
I20260811 16:50:16.952018 26374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:16.951697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:41719)
0811 16:50:16.951915 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:16.951970 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":88,"threads_started":1}
I20260811 16:50:17.283470 26375 raft_consensus.cc:482] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:50:17.283619 26375 raft_consensus.cc:504] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } }
I20260811 16:50:17.283850 26375 leader_election.cc:288] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131:39571), 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455)
W20260811 16:50:17.284349 25740 leader_election.cc:341] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131:39571): Not found: Tablet not found: f5ad26421ff9482abde0ad0b9b239372
W20260811 16:50:17.284461 25741 leader_election.cc:341] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455): Not found: Tablet not found: f5ad26421ff9482abde0ad0b9b239372
I20260811 16:50:17.284518 25741 leader_election.cc:302] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d031912b02c4474f9b40d35ded798eb9; no voters: 18c06a4fd16a43f4a88844af44dfb944, 1a179660b61946a9b0b79cac74f427d3
I20260811 16:50:17.284600 26375 raft_consensus.cc:2726] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:50:17.782336 26376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:17.782054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:46673)
0811 16:50:17.782237 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:17.782286 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":98,"threads_started":1}
I20260811 16:50:17.822623 26379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:17.822383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:60469)
0811 16:50:17.822518 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:17.822567 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
I20260811 16:50:17.952879 26380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:17.952582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:40957)
0811 16:50:17.952744 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:17.952788 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":67,"threads_started":1}
I20260811 16:50:18.783133 26381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:18.782856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:55265)
0811 16:50:18.783025 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:18.783075 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":69,"threads_started":1}
I20260811 16:50:18.823714 26383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:18.823385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:59947)
0811 16:50:18.823592 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:18.823649 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":98,"threads_started":1}
I20260811 16:50:18.953576 26384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:18.953363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:37525)
0811 16:50:18.953491 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:18.953527 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":68,"threads_started":1}
I20260811 16:50:19.222733 26386 raft_consensus.cc:482] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:50:19.222838 26386 raft_consensus.cc:504] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a179660b61946a9b0b79cac74f427d3" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 39571 } } peers { permanent_uuid: "18c06a4fd16a43f4a88844af44dfb944" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 41455 } } peers { permanent_uuid: "d031912b02c4474f9b40d35ded798eb9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43603 } }
I20260811 16:50:19.223012 26386 leader_election.cc:288] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131:39571), 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455)
W20260811 16:50:19.223482 25741 leader_election.cc:341] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 18c06a4fd16a43f4a88844af44dfb944 (127.2.55.130:41455): Not found: Tablet not found: f5ad26421ff9482abde0ad0b9b239372
W20260811 16:50:19.223659 25740 leader_election.cc:341] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1a179660b61946a9b0b79cac74f427d3 (127.2.55.131:39571): Not found: Tablet not found: f5ad26421ff9482abde0ad0b9b239372
I20260811 16:50:19.223754 25740 leader_election.cc:302] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d031912b02c4474f9b40d35ded798eb9; no voters: 18c06a4fd16a43f4a88844af44dfb944, 1a179660b61946a9b0b79cac74f427d3
I20260811 16:50:19.223851 26386 raft_consensus.cc:2726] T f5ad26421ff9482abde0ad0b9b239372 P d031912b02c4474f9b40d35ded798eb9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:50:19.784089 26387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:19.783774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:44489)
0811 16:50:19.783944 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:19.784037 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":74,"threads_started":1}
I20260811 16:50:19.824546 26389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:19.824274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:41117)
0811 16:50:19.824427 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:19.824471 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":67,"threads_started":1}
I20260811 16:50:19.954396 26390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:19.954139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:41243)
0811 16:50:19.954302 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:19.954346 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":71,"threads_started":1}
I20260811 16:50:20.785135 26391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:20.784774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:56239)
0811 16:50:20.785028 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:20.785081 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":143,"threads_started":1}
I20260811 16:50:20.825472 26392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:20.825220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:42181)
0811 16:50:20.825372 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:20.825421 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":67,"threads_started":1}
I20260811 16:50:20.955307 26394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:20.955049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:34671)
0811 16:50:20.955213 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:20.955258 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":74,"threads_started":1}
I20260811 16:50:21.785980 26395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:21.785688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:36023)
0811 16:50:21.785867 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:21.785918 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":68,"threads_started":1}
I20260811 16:50:21.826349 26398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:21.826024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:36147)
0811 16:50:21.826226 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:21.826274 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":118,"threads_started":1}
I20260811 16:50:21.956103 26399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:21.955879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:57945)
0811 16:50:21.956017 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:21.956052 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":70,"threads_started":1}
I20260811 16:50:22.786808 26400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:22.786561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:42771)
0811 16:50:22.786716 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:22.786757 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":80,"threads_started":1}
I20260811 16:50:22.827114 26401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:22.826865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:48771)
0811 16:50:22.827033 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:22.827067 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":112,"threads_started":1}
I20260811 16:50:22.956820 26402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:22.956590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:55277)
0811 16:50:22.956731 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:22.956772 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":71,"threads_started":1}
I20260811 16:50:23.787705 26403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:23.787451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:34007)
0811 16:50:23.787595 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:23.787656 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":72,"threads_started":1}
I20260811 16:50:23.828024 26405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:23.827800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:60519)
0811 16:50:23.827934 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:23.827977 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":67,"threads_started":1}
I20260811 16:50:23.957656 26408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:23.957393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:51459)
0811 16:50:23.957562 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:23.957607 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":73,"threads_started":1}
I20260811 16:50:24.789002 26411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:24.788554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.129:50697)
0811 16:50:24.788780 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:24.788920 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":111,"threads_started":1}
I20260811 16:50:24.829252 26412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:24.828796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.130:38783)
0811 16:50:24.829121 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:24.829183 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":143,"threads_started":1}
I20260811 16:50:24.959152 26414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:24.958499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:35553 (local address 127.2.55.131:56115)
0811 16:50:24.958838 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:24.959007 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:35553: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":144,"threads_started":1}
I20260811 16:50:24.965920 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 25660
I20260811 16:50:24.995198 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 25911
I20260811 16:50:25.021270 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 26122
2026-08-11T16:50:25Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18843 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:50:25 dist-test-slave-3h5h krb5kdc[26417](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:50:25 dist-test-slave-3h5h krb5kdc[26417](info): set up 2 sockets
Aug 11 16:50:25 dist-test-slave-3h5h krb5kdc[26417](info): commencing operation
krb5kdc: starting...
W20260811 16:50:26.580561 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.508s user 0.000s sys 0.013s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:50:26 dist-test-slave-3h5h krb5kdc[26417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:50:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:50:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:50:26.711190 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:39559
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:39559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:50:26.796281 26440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:26.796499 26440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:26.796523 26440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:26.797690 26440 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 16:50:26.797750 26440 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 16:50:26.797765 26440 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 16:50:26.797777 26440 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:50:26.797791 26440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:26.797809 26440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:26.797822 26440 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:50:26.797840 26440 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:50:26.799310 26440 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:39559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:39559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:26.799523 26440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:26.799715 26440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:26.805284 26450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:26.805275 26453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:26.805311 26440 server_base.cc:1034] running on GCE node
W20260811 16:50:26.805271 26449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:26.805737 26440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:26.805990 26440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:26.807168 26440 hybrid_clock.cc:648] HybridClock initialized: now 1786467026807149 us; error 40 us; skew 500 ppm
Aug 11 16:50:26 dist-test-slave-3h5h krb5kdc[26417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467026, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:26.809830 26440 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:50:26.810276 26440 webserver.cc:460] Webserver started at http://127.2.55.190:34207/ using document root <none> and password file <none>
I20260811 16:50:26.810463 26440 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:26.810503 26440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:26.810600 26440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:50:26.811625 26440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "2a8912791ba64a9f8f032196d3d5b563"
format_stamp: "Formatted at 2026-08-11 16:50:26 on dist-test-slave-3h5h"
server_key: "2105e77c8900db415d49ce62925bce05"
server_key_iv: "687bbd79e2200648d754cac89b00fbbc"
server_key_version: "encryptionkey@0"
I20260811 16:50:26.811939 26440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "2a8912791ba64a9f8f032196d3d5b563"
format_stamp: "Formatted at 2026-08-11 16:50:26 on dist-test-slave-3h5h"
server_key: "2105e77c8900db415d49ce62925bce05"
server_key_iv: "687bbd79e2200648d754cac89b00fbbc"
server_key_version: "encryptionkey@0"
I20260811 16:50:26.813264 26440 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:50:26.814052 26465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:26.814224 26440 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:26.814317 26440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "2a8912791ba64a9f8f032196d3d5b563"
format_stamp: "Formatted at 2026-08-11 16:50:26 on dist-test-slave-3h5h"
server_key: "2105e77c8900db415d49ce62925bce05"
server_key_iv: "687bbd79e2200648d754cac89b00fbbc"
server_key_version: "encryptionkey@0"
I20260811 16:50:26.814374 26440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:26.834429 26440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:26.836911 26440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:26.837037 26440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:26.841145 26440 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:39559
I20260811 16:50:26.841220 26551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:39559 every 8 connection(s)
I20260811 16:50:26.841569 26440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:50:26.842588 26553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:26.845047 26553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Bootstrap starting.
I20260811 16:50:26.845654 26553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:26.845975 26553 log.cc:824] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:26.846771 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 26440
I20260811 16:50:26.846797 26553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: No bootstrap required, opened a new log
I20260811 16:50:26.846889 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:50:26.847122 2270 external_mini_cluster.cc:1428] Setting key 0b2fcd56a32af16b7763e448b871e42f
I20260811 16:50:26.848798 26553 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } }
I20260811 16:50:26.849025 26553 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:26.849131 26553 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a8912791ba64a9f8f032196d3d5b563, State: Initialized, Role: FOLLOWER
I20260811 16:50:26.849295 26553 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } }
I20260811 16:50:26.849390 26553 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:50:26.849426 26553 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:50:26.849484 26553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:26.850152 26553 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } }
I20260811 16:50:26.850278 26553 leader_election.cc:302] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a8912791ba64a9f8f032196d3d5b563; no voters:
I20260811 16:50:26.850469 26553 leader_election.cc:288] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:50:26.850502 26561 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:50:26.850622 26561 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 1 LEADER]: Becoming Leader. State: Replica: 2a8912791ba64a9f8f032196d3d5b563, State: Running, Role: LEADER
I20260811 16:50:26.850761 26553 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:50:26.850765 26561 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } }
I20260811 16:50:26.851218 26565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a8912791ba64a9f8f032196d3d5b563. Latest consensus state: current_term: 1 leader_uuid: "2a8912791ba64a9f8f032196d3d5b563" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } } }
I20260811 16:50:26.851364 26565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [sys.catalog]: This master's current role is: LEADER
I20260811 16:50:26.851595 26563 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a8912791ba64a9f8f032196d3d5b563" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } } }
I20260811 16:50:26.851728 26563 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [sys.catalog]: This master's current role is: LEADER
I20260811 16:50:26.851971 26575 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:50:26.852612 26575 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:50:26.855440 26575 catalog_manager.cc:1347] Generated new cluster ID: 0042a797a3df43249db0ed02d20b100b
I20260811 16:50:26.855499 26575 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:50:26 dist-test-slave-3h5h krb5kdc[26417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:26.860275 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:26.847677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41388 (local address 127.2.55.190:39559)
0811 16:50:26.847845 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:26.847852 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:26.847878 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:50:26.848771 (+ 893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:26.848778 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:26.848825 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:26.848985 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:26.849821 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:26.851571 (+ 1750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:26.852725 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:26.853453 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:26.853565 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:26.856182 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:26.856186 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:26.856186 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:26.856198 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:26.858403 (+ 2205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:26.858831 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:26.858834 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:26.858835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:26.858963 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:26.859175 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:26.859176 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:26.859176 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:26.859509 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:26.859666 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:26.859755 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 16:50:26.860046 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":76,"threads_started":1}
I20260811 16:50:26.865446 26575 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:50:26.865986 26575 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:50:26.869462 26575 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Generated new TSK 0
I20260811 16:50:26.869664 26575 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:50:26.904587 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:39559
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:50:27.000594 26600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:27.000882 26600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:27.000928 26600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:27.002161 26600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:27.002234 26600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:27.002283 26600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:50:27.003830 26600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:39559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:27.004117 26600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:27.004357 26600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:27.010462 26610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:27.010470 26609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:27.010623 26600 server_base.cc:1034] running on GCE node
W20260811 16:50:27.010501 26612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:27.010908 26600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:27.011214 26600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:27.012377 26600 hybrid_clock.cc:648] HybridClock initialized: now 1786467027012370 us; error 36 us; skew 500 ppm
Aug 11 16:50:27 dist-test-slave-3h5h krb5kdc[26417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467027, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:27.014963 26600 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:50:27.015444 26600 webserver.cc:460] Webserver started at http://127.2.55.129:35037/ using document root <none> and password file <none>
I20260811 16:50:27.015672 26600 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:27.015738 26600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:27.015887 26600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:50:27.017182 26600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "0f8debf9096243cea1aac54ac826eae3"
format_stamp: "Formatted at 2026-08-11 16:50:27 on dist-test-slave-3h5h"
server_key: "b7d0240472617373c2cb26c7a38fa206"
server_key_iv: "52ebd5238aba0438f2dd3eee3b131113"
server_key_version: "encryptionkey@0"
I20260811 16:50:27.017546 26600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "0f8debf9096243cea1aac54ac826eae3"
format_stamp: "Formatted at 2026-08-11 16:50:27 on dist-test-slave-3h5h"
server_key: "b7d0240472617373c2cb26c7a38fa206"
server_key_iv: "52ebd5238aba0438f2dd3eee3b131113"
server_key_version: "encryptionkey@0"
I20260811 16:50:27.018963 26600 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:27.019761 26623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:27.019934 26600 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:50:27.020082 26600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "0f8debf9096243cea1aac54ac826eae3"
format_stamp: "Formatted at 2026-08-11 16:50:27 on dist-test-slave-3h5h"
server_key: "b7d0240472617373c2cb26c7a38fa206"
server_key_iv: "52ebd5238aba0438f2dd3eee3b131113"
server_key_version: "encryptionkey@0"
I20260811 16:50:27.020162 26600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:27.045392 26600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:27.047551 26600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:27.047735 26600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:27.048002 26600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:50:27.048353 26600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:50:27.048408 26600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:27.048449 26600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:50:27.048492 26600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:27.055266 26600 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:42217
I20260811 16:50:27.055325 26816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:42217 every 8 connection(s)
I20260811 16:50:27.055687 26600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:50:27.061676 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 26600
I20260811 16:50:27.061829 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:50:27.062080 2270 external_mini_cluster.cc:1428] Setting key 9dfa0e2e584b5959e8e10ced89a5882c
Aug 11 16:50:27 dist-test-slave-3h5h krb5kdc[26417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467027, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:27.065943 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.056533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:52925 (local address 127.2.55.190:39559)
0811 16:50:27.056588 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:27.056590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:27.056800 (+ 210us) server_negotiation.cc:407] Connection header received
0811 16:50:27.057327 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:27.057328 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:27.057340 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:27.057405 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:27.058372 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.058882 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.059935 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.060146 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.060215 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.062901 (+ 2686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:27.062903 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:27.062903 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:27.062914 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:27.064458 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:27.064927 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:27.064929 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:27.064929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:27.064988 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:27.065259 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:27.065259 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:27.065260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:27.065374 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:27.065447 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:27.065738 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 16:50:27.065834 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:50:27.066155 26824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.056485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:52925)
0811 16:50:27.056667 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:27.056710 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:27.057241 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:27.057457 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:27.057461 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:27.058064 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:27.058274 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:27.058279 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.058971 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.058972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:27.059835 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:27.059838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.060236 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.060237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:27.060339 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.060859 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:27.060868 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:27.062804 (+ 1936us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:27.064565 (+ 1761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:27.064574 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:27.064576 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:27.064815 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:27.065070 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:27.065071 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:27.065071 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:27.065186 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:27.065438 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:27.065446 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:27.065599 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 16:50:27.065702 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 16:50:27.065876 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":101,"threads_started":1}
I20260811 16:50:27.066670 26821 heartbeater.cc:347] Connected to a master server at 127.2.55.190:39559
I20260811 16:50:27.066780 26821 heartbeater.cc:464] Registering TS with master...
I20260811 16:50:27.066965 26821 heartbeater.cc:511] Master 127.2.55.190:39559 requested a full tablet report, sending...
I20260811 16:50:27.067569 26493 ts_manager.cc:194] Registered new tserver with Master: 0f8debf9096243cea1aac54ac826eae3 (127.2.55.129:42217)
I20260811 16:50:27.068567 26493 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:52925
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:50:27.091856 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:39559
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:50:27.175882 26828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:27.176100 26828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:27.176124 26828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:27.177232 26828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:27.177268 26828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:27.177294 26828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:50:27.178689 26828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:39559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:27.178876 26828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:27.179065 26828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:27.184073 26840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:27.184077 26849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:27.184125 26844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:27.184580 26828 server_base.cc:1034] running on GCE node
I20260811 16:50:27.184787 26828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:27.185052 26828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:27.186192 26828 hybrid_clock.cc:648] HybridClock initialized: now 1786467027186172 us; error 35 us; skew 500 ppm
Aug 11 16:50:27 dist-test-slave-3h5h krb5kdc[26417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467027, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:27.188741 26828 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:50:27.189231 26828 webserver.cc:460] Webserver started at http://127.2.55.130:39827/ using document root <none> and password file <none>
I20260811 16:50:27.189489 26828 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:27.189556 26828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:27.189706 26828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:50:27.190794 26828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "0afbba2075cf4907bd4a44485da57eab"
format_stamp: "Formatted at 2026-08-11 16:50:27 on dist-test-slave-3h5h"
server_key: "7262b25d8839c6365bec7767ecbe6828"
server_key_iv: "6ef904cc143358c550d7dc38030b3dd3"
server_key_version: "encryptionkey@0"
I20260811 16:50:27.191151 26828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "0afbba2075cf4907bd4a44485da57eab"
format_stamp: "Formatted at 2026-08-11 16:50:27 on dist-test-slave-3h5h"
server_key: "7262b25d8839c6365bec7767ecbe6828"
server_key_iv: "6ef904cc143358c550d7dc38030b3dd3"
server_key_version: "encryptionkey@0"
I20260811 16:50:27.192482 26828 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:50:27.193276 26866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:27.193447 26828 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:27.193555 26828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "0afbba2075cf4907bd4a44485da57eab"
format_stamp: "Formatted at 2026-08-11 16:50:27 on dist-test-slave-3h5h"
server_key: "7262b25d8839c6365bec7767ecbe6828"
server_key_iv: "6ef904cc143358c550d7dc38030b3dd3"
server_key_version: "encryptionkey@0"
I20260811 16:50:27.193624 26828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:27.212522 26828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:27.214444 26828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:27.214609 26828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:27.214851 26828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:50:27.215167 26828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:50:27.215201 26828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:27.215224 26828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:50:27.215252 26828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:27.221531 26828 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:40207
I20260811 16:50:27.221577 27044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:40207 every 8 connection(s)
I20260811 16:50:27.221897 26828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:50:27.227542 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 26828
I20260811 16:50:27.227661 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
Aug 11 16:50:27 dist-test-slave-3h5h krb5kdc[26417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467027, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:27.227895 2270 external_mini_cluster.cc:1428] Setting key 58489877a213ec1c71c65d4dc6944202
I20260811 16:50:27.231561 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.222630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:38443 (local address 127.2.55.190:39559)
0811 16:50:27.222676 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:27.222678 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:27.222874 (+ 196us) server_negotiation.cc:407] Connection header received
0811 16:50:27.223357 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:27.223358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:27.223368 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:27.223426 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:27.224364 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.224920 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.225879 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.226067 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.226121 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.228448 (+ 2327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:27.228449 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:27.228449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:27.228457 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:27.230127 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:27.230521 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:27.230522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:27.230523 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:27.230596 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:27.230898 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:27.230899 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:27.230899 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:27.231003 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:27.231059 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:27.231424 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 16:50:27.231495 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:50:27.231834 27049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.222595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:38443)
0811 16:50:27.222754 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:27.222799 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:27.223274 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:27.223478 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:27.223481 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:27.224096 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:27.224286 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:27.224291 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.225008 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.225009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:27.225808 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:27.225810 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.226136 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.226137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:27.226232 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.226667 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:27.226675 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:27.228358 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:27.230216 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:27.230222 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:27.230224 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:27.230447 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:27.230675 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:27.230676 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:27.230677 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:27.230827 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:27.231104 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:27.231110 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:27.231277 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 16:50:27.231394 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 16:50:27.231575 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":89,"threads_started":1}
I20260811 16:50:27.232366 27046 heartbeater.cc:347] Connected to a master server at 127.2.55.190:39559
I20260811 16:50:27.232483 27046 heartbeater.cc:464] Registering TS with master...
I20260811 16:50:27.232673 27046 heartbeater.cc:511] Master 127.2.55.190:39559 requested a full tablet report, sending...
I20260811 16:50:27.233160 26493 ts_manager.cc:194] Registered new tserver with Master: 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207)
I20260811 16:50:27.233534 26493 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:38443
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:50:27.258165 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:39559
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:50:27.346266 27054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:27.346525 27054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:27.346570 27054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:27.347740 27054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:27.347816 27054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:27.347862 27054 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:50:27.349395 27054 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:39559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:27.349677 27054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:27.349922 27054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:27.355345 27062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:27.355352 27061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:27.355357 27065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:27.355829 27054 server_base.cc:1034] running on GCE node
I20260811 16:50:27.356055 27054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:27.356256 27054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:27.357393 27054 hybrid_clock.cc:648] HybridClock initialized: now 1786467027357379 us; error 31 us; skew 500 ppm
Aug 11 16:50:27 dist-test-slave-3h5h krb5kdc[26417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467027, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:27.359969 27054 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:50:27.360531 27054 webserver.cc:460] Webserver started at http://127.2.55.131:41197/ using document root <none> and password file <none>
I20260811 16:50:27.360785 27054 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:27.360870 27054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:27.361023 27054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:50:27.362095 27054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "24c7f3bd966e47309aeb94b7dd0cbd94"
format_stamp: "Formatted at 2026-08-11 16:50:27 on dist-test-slave-3h5h"
server_key: "bead3e7e0bb431ac24b315df1ed37cef"
server_key_iv: "5d34bc0b3db64d5660c8caa4e7061e2f"
server_key_version: "encryptionkey@0"
I20260811 16:50:27.362474 27054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "24c7f3bd966e47309aeb94b7dd0cbd94"
format_stamp: "Formatted at 2026-08-11 16:50:27 on dist-test-slave-3h5h"
server_key: "bead3e7e0bb431ac24b315df1ed37cef"
server_key_iv: "5d34bc0b3db64d5660c8caa4e7061e2f"
server_key_version: "encryptionkey@0"
I20260811 16:50:27.363866 27054 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:50:27.364660 27077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:27.364894 27054 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:50:27.365003 27054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "24c7f3bd966e47309aeb94b7dd0cbd94"
format_stamp: "Formatted at 2026-08-11 16:50:27 on dist-test-slave-3h5h"
server_key: "bead3e7e0bb431ac24b315df1ed37cef"
server_key_iv: "5d34bc0b3db64d5660c8caa4e7061e2f"
server_key_version: "encryptionkey@0"
I20260811 16:50:27.365083 27054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:27.375499 27054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:27.377684 27054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:27.377856 27054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:27.378088 27054 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:50:27.378422 27054 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:50:27.378477 27054 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:27.378520 27054 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:50:27.378549 27054 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:27.384799 27054 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:33097
I20260811 16:50:27.384861 27274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:33097 every 8 connection(s)
I20260811 16:50:27.385202 27054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:50:27 dist-test-slave-3h5h krb5kdc[26417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467027, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:27.394243 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 27054
I20260811 16:50:27.394345 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:50:27.394384 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.385933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:39165 (local address 127.2.55.190:39559)
0811 16:50:27.385979 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:27.385981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:27.386195 (+ 214us) server_negotiation.cc:407] Connection header received
0811 16:50:27.386703 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:27.386704 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:27.386715 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:27.386772 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:27.387802 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.388307 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.389410 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.389655 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.389718 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.391833 (+ 2115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:27.391835 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:27.391835 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:27.391841 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:27.393082 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:27.393435 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:27.393436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:27.393436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:27.393488 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:27.393722 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:27.393722 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:27.393723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:27.393823 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:27.393876 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:27.394168 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 16:50:27.394259 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:50:27.394420 27280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.385887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:39165)
0811 16:50:27.386059 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:27.386105 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:27.386586 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:27.386848 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:27.386851 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:27.387518 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:27.387720 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:27.387725 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.388391 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.388392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:27.389327 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:27.389329 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.389735 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.389736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:27.389834 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.390395 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:27.390404 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:27.391742 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:27.393152 (+ 1410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:27.393159 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:27.393161 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:27.393371 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:27.393558 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:27.393559 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:27.393559 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:27.393653 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:27.393875 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:27.393880 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:27.394006 (+ 126us) client_negotiation.cc:769] Sending connection context
0811 16:50:27.394091 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 16:50:27.394210 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":92,"threads_started":1}
I20260811 16:50:27.394554 2270 external_mini_cluster.cc:1428] Setting key 94871454219e1b860e993ff534f956c5
I20260811 16:50:27.394987 27276 heartbeater.cc:347] Connected to a master server at 127.2.55.190:39559
I20260811 16:50:27.395167 27276 heartbeater.cc:464] Registering TS with master...
I20260811 16:50:27.395383 27276 heartbeater.cc:511] Master 127.2.55.190:39559 requested a full tablet report, sending...
I20260811 16:50:27.395767 26493 ts_manager.cc:194] Registered new tserver with Master: 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097)
I20260811 16:50:27.396157 26493 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:39165
I20260811 16:50:27.406605 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:50:27.414665 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.408098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41398 (local address 127.2.55.190:39559)
0811 16:50:27.408162 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:27.408163 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:27.408306 (+ 143us) server_negotiation.cc:407] Connection header received
0811 16:50:27.408361 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:27.408362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:27.408373 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:27.408410 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:27.409103 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.409591 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.410483 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.410709 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.410787 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.412152 (+ 1365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:27.412153 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:27.412153 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:27.412159 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:27.413640 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:27.413990 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:27.413990 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:27.413991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:27.414042 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:27.414222 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:27.414222 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:27.414223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:27.414361 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:27.414437 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:27.414522 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 16:50:27.414600 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:50:27.416195 26493 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41398:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:50:27.418174 26493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:50:27.424855 27297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.420819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46544 (local address 127.2.55.130:40207)
0811 16:50:27.421012 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:27.421017 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:27.421027 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:50:27.421069 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:27.421071 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:27.421091 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:27.421172 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:27.421369 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.422131 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.423767 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.424472 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.424575 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.424634 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:27.424710 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 16:50:27.424748 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":103,"threads_started":1}
I20260811 16:50:27.424865 27295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.420441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:40207 (local address 127.0.0.1:46544)
0811 16:50:27.420787 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:27.420797 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:27.420867 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:27.421196 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:27.421199 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:27.421202 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:27.421282 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:27.421284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.422246 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.422247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:27.423468 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:27.423471 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.424578 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.424580 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:27.424643 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.424647 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:50:27.424700 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 16:50:27.424733 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":4,"thread_start_us":86,"threads_started":1}
I20260811 16:50:27.424870 27293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.420436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:42217 (local address 127.0.0.1:35262)
0811 16:50:27.420589 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:27.420632 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:27.420698 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:27.421199 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:27.421200 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:27.421203 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:27.421281 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:27.421284 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.422610 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.422611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:27.423664 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:27.423666 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.424587 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.424588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:27.424663 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.424667 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:50:27.424700 (+ 33us) client_negotiation.cc:240] Negotiation successful
0811 16:50:27.424744 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":30,"thread_start_us":58,"threads_started":1}
I20260811 16:50:27.424945 27296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.420778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33234 (local address 127.2.55.131:33097)
0811 16:50:27.421338 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:27.421343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:27.421353 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:50:27.421394 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:27.421396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:27.421414 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:27.421488 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:27.421696 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.422750 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.423850 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.424381 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.424469 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.424532 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:27.424794 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 16:50:27.424856 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":113,"threads_started":1}
I20260811 16:50:27.424997 27292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.420663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:33097 (local address 127.0.0.1:33234)
0811 16:50:27.420906 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:27.420915 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:27.420960 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:27.421573 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:27.421574 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:27.421576 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:27.421619 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:27.421620 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.422876 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.422877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:27.423768 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:27.423771 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.424472 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.424473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:27.424555 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.424569 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:50:27.424642 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 16:50:27.424713 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":3,"thread_start_us":73,"threads_started":1}
I20260811 16:50:27.425423 27294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.420561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35262 (local address 127.2.55.129:42217)
0811 16:50:27.421019 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:27.421024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:27.421035 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:50:27.421078 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:27.421079 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:27.421091 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:27.421183 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:27.421372 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.422505 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.423739 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.424461 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.425217 (+ 756us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.425286 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:27.425311 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 16:50:27.425351 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":109,"threads_started":1}
I20260811 16:50:27.425720 27165 tablet_service.cc:1467] Processing CreateTablet for tablet 249e7c1898ba46f69e4eee75b0a99655 (DEFAULT_TABLE table=test-table [id=cba65e2f35554c06a68bb382c4389d71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:50:27.426113 27165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 249e7c1898ba46f69e4eee75b0a99655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:27.426030 26952 tablet_service.cc:1467] Processing CreateTablet for tablet 249e7c1898ba46f69e4eee75b0a99655 (DEFAULT_TABLE table=test-table [id=cba65e2f35554c06a68bb382c4389d71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:50:27.426098 26716 tablet_service.cc:1467] Processing CreateTablet for tablet 249e7c1898ba46f69e4eee75b0a99655 (DEFAULT_TABLE table=test-table [id=cba65e2f35554c06a68bb382c4389d71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:50:27.426342 26952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 249e7c1898ba46f69e4eee75b0a99655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:27.426460 26716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 249e7c1898ba46f69e4eee75b0a99655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:27.428908 27298 tablet_bootstrap.cc:492] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab: Bootstrap starting.
I20260811 16:50:27.429531 27299 tablet_bootstrap.cc:492] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94: Bootstrap starting.
I20260811 16:50:27.429587 27298 tablet_bootstrap.cc:654] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:27.430119 27301 tablet_bootstrap.cc:492] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3: Bootstrap starting.
I20260811 16:50:27.430189 27298 log.cc:824] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:27.430251 27299 tablet_bootstrap.cc:654] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:27.430801 27301 tablet_bootstrap.cc:654] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:27.430825 27299 log.cc:824] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:27.431084 27298 tablet_bootstrap.cc:492] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab: No bootstrap required, opened a new log
I20260811 16:50:27.431186 27298 ts_tablet_manager.cc:1397] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 16:50:27.431414 27301 log.cc:824] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:27.431689 27299 tablet_bootstrap.cc:492] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94: No bootstrap required, opened a new log
I20260811 16:50:27.431761 27299 ts_tablet_manager.cc:1397] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:50:27.432112 27301 tablet_bootstrap.cc:492] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3: No bootstrap required, opened a new log
I20260811 16:50:27.432194 27301 ts_tablet_manager.cc:1397] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:50:27.433264 27298 raft_consensus.cc:348] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } } peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } }
I20260811 16:50:27.433449 27298 raft_consensus.cc:374] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:27.433491 27298 raft_consensus.cc:729] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afbba2075cf4907bd4a44485da57eab, State: Initialized, Role: FOLLOWER
I20260811 16:50:27.433667 27298 consensus_queue.cc:260] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } } peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } }
I20260811 16:50:27.433773 27299 raft_consensus.cc:348] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } } peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } }
I20260811 16:50:27.433947 27299 raft_consensus.cc:374] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:27.433974 27298 ts_tablet_manager.cc:1428] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 16:50:27.434057 27299 raft_consensus.cc:729] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24c7f3bd966e47309aeb94b7dd0cbd94, State: Initialized, Role: FOLLOWER
I20260811 16:50:27.434105 27046 heartbeater.cc:503] Master 127.2.55.190:39559 was elected leader, sending a full tablet report...
I20260811 16:50:27.434018 27301 raft_consensus.cc:348] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } } peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } }
I20260811 16:50:27.434183 27301 raft_consensus.cc:374] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:27.434219 27301 raft_consensus.cc:729] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f8debf9096243cea1aac54ac826eae3, State: Initialized, Role: FOLLOWER
I20260811 16:50:27.434258 27299 consensus_queue.cc:260] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } } peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } }
I20260811 16:50:27.434331 27301 consensus_queue.cc:260] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } } peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } }
I20260811 16:50:27.434567 27299 ts_tablet_manager.cc:1428] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:50:27.434635 27301 ts_tablet_manager.cc:1428] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 16:50:27.434722 27276 heartbeater.cc:503] Master 127.2.55.190:39559 was elected leader, sending a full tablet report...
I20260811 16:50:27.434805 26821 heartbeater.cc:503] Master 127.2.55.190:39559 was elected leader, sending a full tablet report...
I20260811 16:50:27.462684 27312 raft_consensus.cc:482] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:50:27.462818 27312 raft_consensus.cc:504] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } } peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } }
I20260811 16:50:27.463140 27312 leader_election.cc:288] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207), 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097)
I20260811 16:50:27.467710 27297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.463506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:45385 (local address 127.2.55.130:40207)
0811 16:50:27.463588 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:27.463598 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:27.463611 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:50:27.463644 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:27.463645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:27.463663 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:27.463726 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:27.463931 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.464880 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.466568 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.467300 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.467370 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.467378 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:27.467571 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 16:50:27.467635 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 16:50:27.467715 26824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.463400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:40207 (local address 127.2.55.129:45385)
0811 16:50:27.463482 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:27.463498 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:27.463567 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:27.463760 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:27.463761 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:27.463763 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:27.463846 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:27.463849 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.465084 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.465084 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:27.466451 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:27.466455 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.467410 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.467410 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:27.467483 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.467486 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:50:27.467542 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 16:50:27.467593 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":78}
I20260811 16:50:27.467746 27296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.463647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:55503 (local address 127.2.55.131:33097)
0811 16:50:27.463724 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:27.463726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:27.463897 (+ 171us) server_negotiation.cc:407] Connection header received
0811 16:50:27.463934 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:27.463935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:27.463946 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:27.464016 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:27.464135 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.464958 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.466569 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.467245 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.467361 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.467372 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:27.467626 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 16:50:27.467675 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:50:27.467907 27313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.463571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:33097 (local address 127.2.55.129:55503)
0811 16:50:27.463791 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:27.463801 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:27.463858 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:27.464023 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:27.464023 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:27.464025 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:27.464078 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:27.464079 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.465036 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.465037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:27.466451 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:27.466455 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.467368 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.467370 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:27.467452 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.467459 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 16:50:27.467579 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 16:50:27.467612 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":62,"thread_start_us":143,"threads_started":1}
I20260811 16:50:27.468164 26978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "249e7c1898ba46f69e4eee75b0a99655" candidate_uuid: "0f8debf9096243cea1aac54ac826eae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afbba2075cf4907bd4a44485da57eab" is_pre_election: true
I20260811 16:50:27.468259 27205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "249e7c1898ba46f69e4eee75b0a99655" candidate_uuid: "0f8debf9096243cea1aac54ac826eae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" is_pre_election: true
I20260811 16:50:27.468360 26978 raft_consensus.cc:2454] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f8debf9096243cea1aac54ac826eae3 in term 0.
I20260811 16:50:27.468497 27205 raft_consensus.cc:2454] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f8debf9096243cea1aac54ac826eae3 in term 0.
I20260811 16:50:27.468654 26627 leader_election.cc:302] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afbba2075cf4907bd4a44485da57eab, 0f8debf9096243cea1aac54ac826eae3; no voters:
I20260811 16:50:27.468823 27312 raft_consensus.cc:2781] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:50:27.468910 27312 raft_consensus.cc:482] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:50:27.468938 27312 raft_consensus.cc:3037] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:27.469738 27312 raft_consensus.cc:504] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } } peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } }
I20260811 16:50:27.469892 27312 leader_election.cc:288] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 1 election: Requested vote from peers 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207), 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097)
I20260811 16:50:27.470069 27205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "249e7c1898ba46f69e4eee75b0a99655" candidate_uuid: "0f8debf9096243cea1aac54ac826eae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94"
I20260811 16:50:27.470077 26978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "249e7c1898ba46f69e4eee75b0a99655" candidate_uuid: "0f8debf9096243cea1aac54ac826eae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afbba2075cf4907bd4a44485da57eab"
I20260811 16:50:27.470158 26978 raft_consensus.cc:3037] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:27.470160 27205 raft_consensus.cc:3037] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:27.470937 27205 raft_consensus.cc:2454] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f8debf9096243cea1aac54ac826eae3 in term 1.
I20260811 16:50:27.471060 26978 raft_consensus.cc:2454] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f8debf9096243cea1aac54ac826eae3 in term 1.
I20260811 16:50:27.471138 26627 leader_election.cc:302] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f8debf9096243cea1aac54ac826eae3, 24c7f3bd966e47309aeb94b7dd0cbd94; no voters:
I20260811 16:50:27.471251 27312 raft_consensus.cc:2781] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:50:27.471431 27312 raft_consensus.cc:686] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [term 1 LEADER]: Becoming Leader. State: Replica: 0f8debf9096243cea1aac54ac826eae3, State: Running, Role: LEADER
I20260811 16:50:27.471551 27312 consensus_queue.cc:237] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } } peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } }
W20260811 16:50:27.472393 27048 tablet.cc:2369] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:50:27.472471 26489 catalog_manager.cc:5495] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f8debf9096243cea1aac54ac826eae3 (127.2.55.129). New cstate: current_term: 1 leader_uuid: "0f8debf9096243cea1aac54ac826eae3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } health_report { overall_health: UNKNOWN } } }
I20260811 16:50:27.486946 27294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.484621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35278 (local address 127.2.55.129:42217)
0811 16:50:27.484684 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:27.484686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:27.484694 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:50:27.484728 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:27.484728 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:27.484750 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:27.484811 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:50:27.484981 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.485482 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.486245 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:27.486429 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:27.486487 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:27.486623 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:50:27.486728 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:50:27.486797 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:27.486836 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 16:50:27.486854 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 16:50:27.488796 26978 raft_consensus.cc:1261] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab [term 1 FOLLOWER]: Refusing update from remote peer 0f8debf9096243cea1aac54ac826eae3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:50:27.488796 27205 raft_consensus.cc:1261] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 1 FOLLOWER]: Refusing update from remote peer 0f8debf9096243cea1aac54ac826eae3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:50:27.489197 27315 consensus_queue.cc:1035] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:50:27.489346 27312 consensus_queue.cc:1035] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:50:27.492122 27322 mvcc.cc:205] Tried to move back new op lower bound from 7317368944591003648 to 7317368944524156928. Current Snapshot: MvccSnapshot[applied={T|T < 7317368944591003648}]
I20260811 16:50:27.492514 27325 mvcc.cc:205] Tried to move back new op lower bound from 7317368944591003648 to 7317368944524156928. Current Snapshot: MvccSnapshot[applied={T|T < 7317368944591003648}]
I20260811 16:50:27.494814 26491 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:50:27.494916 26491 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:50:27.495700 26491 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Sending DeleteTablet for 3 replicas of tablet 249e7c1898ba46f69e4eee75b0a99655
I20260811 16:50:27.496131 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 26600
I20260811 16:50:27.496151 27165 tablet_service.cc:1514] Processing DeleteTablet for tablet 249e7c1898ba46f69e4eee75b0a99655 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:50:27 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:33234
I20260811 16:50:27.496155 26952 tablet_service.cc:1514] Processing DeleteTablet for tablet 249e7c1898ba46f69e4eee75b0a99655 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:50:27 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:46544
I20260811 16:50:27.503620 27335 tablet_replica.cc:330] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab: stopping tablet replica
I20260811 16:50:27.503770 27335 raft_consensus.cc:2229] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:50:27.503969 27335 raft_consensus.cc:2258] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:50:27.504177 27334 tablet_replica.cc:330] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94: stopping tablet replica
I20260811 16:50:27.504302 27334 raft_consensus.cc:2229] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:50:27.504408 27334 raft_consensus.cc:2258] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:50:27.504933 27334 ts_tablet_manager.cc:1905] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:50:27.504990 27335 ts_tablet_manager.cc:1905] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:50:27.506742 27334 ts_tablet_manager.cc:1918] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:50:27.506824 27334 log.cc:1196] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/249e7c1898ba46f69e4eee75b0a99655
I20260811 16:50:27.507107 27335 ts_tablet_manager.cc:1918] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:50:27.507135 27334 ts_tablet_manager.cc:1939] T 249e7c1898ba46f69e4eee75b0a99655 P 24c7f3bd966e47309aeb94b7dd0cbd94: Deleting consensus metadata
I20260811 16:50:27.507189 27335 log.cc:1196] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/249e7c1898ba46f69e4eee75b0a99655
I20260811 16:50:27.507480 27335 ts_tablet_manager.cc:1939] T 249e7c1898ba46f69e4eee75b0a99655 P 0afbba2075cf4907bd4a44485da57eab: Deleting consensus metadata
I20260811 16:50:27.507642 26469 catalog_manager.cc:4841] TS 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097): tablet 249e7c1898ba46f69e4eee75b0a99655 (table test-table [id=cba65e2f35554c06a68bb382c4389d71]) successfully deleted
I20260811 16:50:27.507884 26469 catalog_manager.cc:4841] TS 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207): tablet 249e7c1898ba46f69e4eee75b0a99655 (table test-table [id=cba65e2f35554c06a68bb382c4389d71]) successfully deleted
W20260811 16:50:27.509831 26470 connection.cc:535] client connection to 127.2.55.129:42217 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 16:50:27.509933 26470 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 16:50:27.510074 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 26828
I20260811 16:50:27.515722 27292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:27.515561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:42217 (local address 127.0.0.1:35284)
0811 16:50:27.515631 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:27.515684 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:42217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 16:50:27.515915 26470 catalog_manager.cc:4584] TS 0f8debf9096243cea1aac54ac826eae3 (127.2.55.129:42217): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 249e7c1898ba46f69e4eee75b0a99655: Network error: Client connection negotiation failed: client connection to 127.2.55.129:42217: connect: Connection refused (error 111)
I20260811 16:50:27.522243 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 27054
I20260811 16:50:27.534412 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 26440
I20260811 16:50:47.545094 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:39559
--webserver_interface=127.2.55.190
--webserver_port=34207
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:39559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:50:47.631861 27337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:47.632102 27337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:47.632126 27337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:47.633433 27337 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 16:50:47.633478 27337 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 16:50:47.633491 27337 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 16:50:47.633507 27337 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:50:47.633558 27337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:47.633577 27337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:47.633600 27337 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:50:47.633630 27337 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:50:47.635169 27337 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:39559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:39559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=34207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:47.635419 27337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:47.635673 27337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:47.645737 27352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:47.645732 27349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:47.645736 27350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:47.645838 27337 server_base.cc:1034] running on GCE node
I20260811 16:50:47.646335 27337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:47.646664 27337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:47.647864 27337 hybrid_clock.cc:648] HybridClock initialized: now 1786467047647840 us; error 38 us; skew 500 ppm
Aug 11 16:50:47 dist-test-slave-3h5h krb5kdc[26417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467047, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:47.650465 27337 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:50:47.650978 27337 webserver.cc:460] Webserver started at http://127.2.55.190:34207/ using document root <none> and password file <none>
I20260811 16:50:47.651301 27337 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:47.651386 27337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:47.652886 27337 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:50:47.653647 27365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:47.653860 27337 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:47.653959 27337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "2a8912791ba64a9f8f032196d3d5b563"
format_stamp: "Formatted at 2026-08-11 16:50:26 on dist-test-slave-3h5h"
server_key: "2105e77c8900db415d49ce62925bce05"
server_key_iv: "687bbd79e2200648d754cac89b00fbbc"
server_key_version: "encryptionkey@0"
I20260811 16:50:47.654385 27337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:47.667017 27337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:47.669152 27337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:47.669324 27337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:47.673899 27337 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:39559
I20260811 16:50:47.673945 27448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:39559 every 8 connection(s)
I20260811 16:50:47.674401 27337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:50:47.675968 27450 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:50:47.676689 27450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Bootstrap starting.
I20260811 16:50:47.681672 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 27337
I20260811 16:50:47.681994 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:42217
--local_ip_for_outbound_sockets=127.2.55.129
--tserver_master_addrs=127.2.55.190:39559
--webserver_port=35037
--webserver_interface=127.2.55.129
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:50:47.686640 27450 log.cc:824] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:47.689392 27450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:50:47.689778 27450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Bootstrap complete.
I20260811 16:50:47.692466 27450 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } }
I20260811 16:50:47.692721 27450 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a8912791ba64a9f8f032196d3d5b563, State: Initialized, Role: FOLLOWER
I20260811 16:50:47.692938 27450 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } }
I20260811 16:50:47.693022 27450 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:50:47.693085 27450 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:50:47.693142 27450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:50:47.694319 27450 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } }
I20260811 16:50:47.694416 27450 leader_election.cc:302] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a8912791ba64a9f8f032196d3d5b563; no voters:
I20260811 16:50:47.694669 27450 leader_election.cc:288] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 16:50:47.694710 27456 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:50:47.694902 27456 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 2 LEADER]: Becoming Leader. State: Replica: 2a8912791ba64a9f8f032196d3d5b563, State: Running, Role: LEADER
I20260811 16:50:47.694986 27450 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:50:47.695118 27456 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } }
I20260811 16:50:47.695463 27458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2a8912791ba64a9f8f032196d3d5b563" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } } }
I20260811 16:50:47.695577 27458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [sys.catalog]: This master's current role is: LEADER
I20260811 16:50:47.695464 27456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a8912791ba64a9f8f032196d3d5b563. Latest consensus state: current_term: 2 leader_uuid: "2a8912791ba64a9f8f032196d3d5b563" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } } }
I20260811 16:50:47.695709 27456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [sys.catalog]: This master's current role is: LEADER
I20260811 16:50:47.695892 27467 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:50:47.697158 27467 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:50:47.697359 27467 catalog_manager.cc:1259] Loaded cluster ID: 0042a797a3df43249db0ed02d20b100b
I20260811 16:50:47.697604 27467 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:50:47.698510 27467 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:50:47.698776 27467 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Loaded TSK: 0
I20260811 16:50:47.712579 27467 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Generated new TSK 1
I20260811 16:50:47.712723 27467 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 16:50:47.786912 27452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:47.787128 27452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:47.787153 27452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:47.788323 27452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:47.788367 27452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:47.788394 27452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:50:47.789971 27452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:42217
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=35037
--tserver_master_addrs=127.2.55.190:39559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:47.790232 27452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:47.790477 27452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:47.796739 27503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:47.796802 27499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:47.796743 27500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:47.797169 27452 server_base.cc:1034] running on GCE node
I20260811 16:50:47.797431 27452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:47.797696 27452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:47.798869 27452 hybrid_clock.cc:648] HybridClock initialized: now 1786467047798853 us; error 33 us; skew 500 ppm
Aug 11 16:50:47 dist-test-slave-3h5h krb5kdc[26417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467047, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:47.801672 27452 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:50:47.802255 27452 webserver.cc:460] Webserver started at http://127.2.55.129:35037/ using document root <none> and password file <none>
I20260811 16:50:47.802536 27452 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:47.802625 27452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:47.804486 27452 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 16:50:47.805353 27512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:47.805575 27452 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:50:47.805681 27452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "0f8debf9096243cea1aac54ac826eae3"
format_stamp: "Formatted at 2026-08-11 16:50:27 on dist-test-slave-3h5h"
server_key: "b7d0240472617373c2cb26c7a38fa206"
server_key_iv: "52ebd5238aba0438f2dd3eee3b131113"
server_key_version: "encryptionkey@0"
I20260811 16:50:47.806119 27452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:47.822041 27452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:47.824549 27452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:47.824707 27452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:47.825008 27452 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:50:47.825527 27521 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 16:50:47.827044 27452 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 16:50:47.827107 27452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 16:50:47.827143 27452 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 16:50:47.828029 27452 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 16:50:47.828079 27452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 16:50:47.828155 27521 tablet_bootstrap.cc:492] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3: Bootstrap starting.
I20260811 16:50:47.835536 27452 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:42217
I20260811 16:50:47.835624 27700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:42217 every 8 connection(s)
I20260811 16:50:47.836184 27452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:50:47.839032 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 27452
I20260811 16:50:47.839361 27521 log.cc:824] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:47.839401 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:40207
--local_ip_for_outbound_sockets=127.2.55.130
--tserver_master_addrs=127.2.55.190:39559
--webserver_port=39827
--webserver_interface=127.2.55.130
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:50:47.842454 27521 tablet_bootstrap.cc:492] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:50:47.842824 27521 tablet_bootstrap.cc:492] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3: Bootstrap complete.
I20260811 16:50:47.844084 27521 ts_tablet_manager.cc:1397] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.009s
I20260811 16:50:47.845543 27521 raft_consensus.cc:348] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } } peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } }
I20260811 16:50:47.845873 27521 raft_consensus.cc:729] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f8debf9096243cea1aac54ac826eae3, State: Initialized, Role: FOLLOWER
I20260811 16:50:47.846019 27521 consensus_queue.cc:260] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } } peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } }
I20260811 16:50:47.846300 27521 ts_tablet_manager.cc:1428] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
Aug 11 16:50:47 dist-test-slave-3h5h krb5kdc[26417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467047, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:47.854031 27705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:47.837033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:47457)
0811 16:50:47.840433 (+ 3400us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:47.840480 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:47.841312 (+ 832us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:47.841833 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:47.841840 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:47.842269 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:47.842575 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:47.842583 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:47.844386 (+ 1803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:47.844388 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:47.845842 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:47.845847 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:47.846766 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:47.846767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:47.846912 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:47.847600 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:47.847611 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:47.849605 (+ 1994us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:47.852056 (+ 2451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:47.852065 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:47.852068 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:47.852426 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:47.852737 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:47.852739 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:47.852739 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:47.852923 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:47.853366 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:47.853372 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:47.853525 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 16:50:47.853628 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 16:50:47.853810 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3355,"thread_start_us":98,"threads_started":1}
I20260811 16:50:47.854063 27706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:47.837146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:47457 (local address 127.2.55.190:39559)
0811 16:50:47.837394 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:47.837404 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:47.841403 (+ 3999us) server_negotiation.cc:407] Connection header received
0811 16:50:47.841550 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:47.841556 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:47.841618 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:47.842723 (+ 1105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:47.842811 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:47.844260 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:47.845974 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:47.846652 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:47.846775 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:47.849752 (+ 2977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:47.849757 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:47.849757 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:47.849770 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:47.851959 (+ 2189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:47.852540 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:47.852544 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:47.852544 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:47.852657 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:47.853008 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:47.853009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:47.853010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:47.853288 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:47.853369 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:47.853726 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 16:50:47.853858 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":113,"threads_started":1}
I20260811 16:50:47.855437 27701 heartbeater.cc:347] Connected to a master server at 127.2.55.190:39559
I20260811 16:50:47.855561 27701 heartbeater.cc:464] Registering TS with master...
I20260811 16:50:47.855746 27701 heartbeater.cc:511] Master 127.2.55.190:39559 requested a full tablet report, sending...
I20260811 16:50:47.856597 27397 ts_manager.cc:194] Registered new tserver with Master: 0f8debf9096243cea1aac54ac826eae3 (127.2.55.129:42217)
I20260811 16:50:47.857856 27397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:47457
I20260811 16:50:47.858844 27701 heartbeater.cc:503] Master 127.2.55.190:39559 was elected leader, sending a full tablet report...
I20260811 16:50:47.865474 27711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:47.857311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:42217 (local address 127.0.0.1:34364)
0811 16:50:47.860967 (+ 3656us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:47.861009 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:47.861079 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:47.861408 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:47.861411 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:47.861413 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:47.861477 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:47.861479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:47.862840 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:47.862842 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:47.864141 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:47.864145 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:47.865112 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:47.865113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:47.865213 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:47.865229 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 16:50:47.865328 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 16:50:47.865387 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3617,"thread_start_us":121,"threads_started":1}
I20260811 16:50:47.865553 27712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:47.857600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34364 (local address 127.2.55.129:42217)
0811 16:50:47.861217 (+ 3617us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:47.861221 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:47.861230 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:50:47.861263 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:47.861265 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:47.861280 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:47.861345 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:47.861572 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:47.862741 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:47.864253 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:47.865022 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:47.865097 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:47.865150 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:47.865418 (+ 268us) server_negotiation.cc:299] Negotiation successful
0811 16:50:47.865460 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3585,"thread_start_us":77,"threads_started":1}
I20260811 16:50:47.866335 27592 tablet_service.cc:1514] Processing DeleteTablet for tablet 249e7c1898ba46f69e4eee75b0a99655 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:50:27 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:34364
I20260811 16:50:47.867053 27713 tablet_replica.cc:330] stopping tablet replica
I20260811 16:50:47.867178 27713 raft_consensus.cc:2229] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:50:47.867251 27713 raft_consensus.cc:2258] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:50:47.867587 27713 ts_tablet_manager.cc:1905] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:50:47.870517 27713 ts_tablet_manager.cc:1918] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:50:47.870608 27713 log.cc:1196] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal/wals/249e7c1898ba46f69e4eee75b0a99655
I20260811 16:50:47.870905 27713 ts_tablet_manager.cc:1939] T 249e7c1898ba46f69e4eee75b0a99655 P 0f8debf9096243cea1aac54ac826eae3: Deleting consensus metadata
I20260811 16:50:47.871501 27369 catalog_manager.cc:4841] TS 0f8debf9096243cea1aac54ac826eae3 (127.2.55.129:42217): tablet 249e7c1898ba46f69e4eee75b0a99655 (table test-table [id=cba65e2f35554c06a68bb382c4389d71]) successfully deleted
W20260811 16:50:47.932235 27708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:47.932476 27708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:47.932518 27708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:47.933869 27708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:47.933938 27708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:47.933983 27708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:50:47.935439 27708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:40207
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=39827
--tserver_master_addrs=127.2.55.190:39559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:47.935703 27708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:47.935946 27708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:50:47.941181 27708 server_base.cc:1034] running on GCE node
W20260811 16:50:47.941143 27720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:47.941123 27723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:47.941111 27721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:47.941658 27708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:47.941916 27708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:47.943089 27708 hybrid_clock.cc:648] HybridClock initialized: now 1786467047943085 us; error 41 us; skew 500 ppm
Aug 11 16:50:47 dist-test-slave-3h5h krb5kdc[26417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467047, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:47.945698 27708 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:50:47.946125 27708 webserver.cc:460] Webserver started at http://127.2.55.130:39827/ using document root <none> and password file <none>
I20260811 16:50:47.946354 27708 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:47.946442 27708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:47.947804 27708 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:50:47.948421 27732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:47.948616 27708 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:50:47.948731 27708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "0afbba2075cf4907bd4a44485da57eab"
format_stamp: "Formatted at 2026-08-11 16:50:27 on dist-test-slave-3h5h"
server_key: "7262b25d8839c6365bec7767ecbe6828"
server_key_iv: "6ef904cc143358c550d7dc38030b3dd3"
server_key_version: "encryptionkey@0"
I20260811 16:50:47.949134 27708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:47.968384 27708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:47.970661 27708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:47.970845 27708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:47.971150 27708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:50:47.971551 27708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:50:47.971596 27708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:47.971625 27708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:50:47.971642 27708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:47.977916 27708 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:40207
I20260811 16:50:47.977964 27921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:40207 every 8 connection(s)
I20260811 16:50:47.978343 27708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:50:47 dist-test-slave-3h5h krb5kdc[26417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467047, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:47.987330 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 27708
I20260811 16:50:47.987675 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:33097
--local_ip_for_outbound_sockets=127.2.55.131
--tserver_master_addrs=127.2.55.190:39559
--webserver_port=41197
--webserver_interface=127.2.55.131
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:50:47.988279 27706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:47.979161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:40103 (local address 127.2.55.190:39559)
0811 16:50:47.979242 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:47.979245 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:47.979489 (+ 244us) server_negotiation.cc:407] Connection header received
0811 16:50:47.980119 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:47.980120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:47.980135 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:47.980203 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:47.981304 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:47.981858 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:47.982866 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:47.983085 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:47.983150 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:47.985342 (+ 2192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:47.985344 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:47.985344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:47.985351 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:47.986688 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:47.987134 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:47.987136 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:47.987136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:47.987216 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:47.987498 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:47.987499 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:47.987500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:47.987633 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:47.987715 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:47.988069 (+ 354us) server_negotiation.cc:299] Negotiation successful
0811 16:50:47.988184 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 16:50:47.988431 27927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:47.979161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:40103)
0811 16:50:47.979358 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:47.979397 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:47.979908 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:47.980286 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:47.980290 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:47.980995 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:47.981203 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:47.981208 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:47.981957 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:47.981958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:47.982772 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:47.982774 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:47.983167 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:47.983168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:47.983267 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:47.983830 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:47.983839 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:47.985252 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:47.986768 (+ 1516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:47.986775 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:47.986776 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:47.986996 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:47.987301 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:47.987302 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:47.987302 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:47.987403 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:47.987716 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:47.987725 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:47.987923 (+ 198us) client_negotiation.cc:769] Sending connection context
0811 16:50:47.988031 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 16:50:47.988197 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":106,"threads_started":1}
I20260811 16:50:47.988983 27923 heartbeater.cc:347] Connected to a master server at 127.2.55.190:39559
I20260811 16:50:47.989104 27923 heartbeater.cc:464] Registering TS with master...
I20260811 16:50:47.989342 27923 heartbeater.cc:511] Master 127.2.55.190:39559 requested a full tablet report, sending...
I20260811 16:50:47.989763 27397 ts_manager.cc:194] Registered new tserver with Master: 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207)
I20260811 16:50:47.990159 27397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:40103
W20260811 16:50:48.076284 27928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:50:48.076542 27928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:50:48.076571 27928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:50:48.077939 27928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:50:48.078004 27928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:50:48.078034 27928 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:50:48.079620 27928 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:33097
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=41197
--tserver_master_addrs=127.2.55.190:39559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:50:48.079886 27928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:50:48.080150 27928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:50:48.085779 27940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:48.085814 27943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:50:48.085846 27946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:50:48.086097 27928 server_base.cc:1034] running on GCE node
I20260811 16:50:48.086315 27928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:50:48.086521 27928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:50:48.087658 27928 hybrid_clock.cc:648] HybridClock initialized: now 1786467048087647 us; error 32 us; skew 500 ppm
Aug 11 16:50:48 dist-test-slave-3h5h krb5kdc[26417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467048, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:50:48.090329 27928 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:50:48.090737 27928 webserver.cc:460] Webserver started at http://127.2.55.131:41197/ using document root <none> and password file <none>
I20260811 16:50:48.090924 27928 fs_manager.cc:359] Metadata directory not provided
I20260811 16:50:48.091041 27928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:50:48.092394 27928 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:50:48.093030 27955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:48.093197 27928 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:48.093288 27928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "24c7f3bd966e47309aeb94b7dd0cbd94"
format_stamp: "Formatted at 2026-08-11 16:50:27 on dist-test-slave-3h5h"
server_key: "bead3e7e0bb431ac24b315df1ed37cef"
server_key_iv: "5d34bc0b3db64d5660c8caa4e7061e2f"
server_key_version: "encryptionkey@0"
I20260811 16:50:48.093605 27928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:50:48.106241 27928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:50:48.108448 27928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:50:48.108568 27928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:50:48.108757 27928 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:50:48.109114 27928 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:50:48.109151 27928 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:48.109208 27928 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:50:48.109239 27928 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:48.115721 27928 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:33097
I20260811 16:50:48.115808 28139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:33097 every 8 connection(s)
I20260811 16:50:48.116155 27928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:50:48 dist-test-slave-3h5h krb5kdc[26417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467048, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:50:48.124450 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 27928
I20260811 16:50:48.127101 27706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:48.117103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:56059 (local address 127.2.55.190:39559)
0811 16:50:48.117172 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:48.117174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:48.117401 (+ 227us) server_negotiation.cc:407] Connection header received
0811 16:50:48.117893 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:48.117894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:48.117904 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:48.117960 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:48.119233 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.119723 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.121037 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.121226 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.121286 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:48.123661 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:48.123663 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:48.123663 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:48.123678 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:48.125572 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:48.126112 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:48.126113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:48.126113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:48.126209 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:48.126465 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:48.126466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:48.126466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:48.126592 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:48.126660 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:48.126967 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 16:50:48.127037 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:50:48.127435 28145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:48.117066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:56059)
0811 16:50:48.117253 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:48.117299 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:48.117800 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:48.118266 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:48.118270 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:48.118883 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:50:48.119145 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:48.119151 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.119834 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.119835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:48.120773 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:48.120776 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.121322 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.121323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:48.121440 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:48.122092 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:50:48.122101 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:50:48.123557 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:50:48.125652 (+ 2095us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:48.125659 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:48.125661 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:48.126030 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:48.126285 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:50:48.126286 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:50:48.126286 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:50:48.126395 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:50:48.126661 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:50:48.126666 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:50:48.126789 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 16:50:48.126924 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 16:50:48.127187 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":103,"threads_started":1}
I20260811 16:50:48.127978 28141 heartbeater.cc:347] Connected to a master server at 127.2.55.190:39559
I20260811 16:50:48.128109 28141 heartbeater.cc:464] Registering TS with master...
I20260811 16:50:48.128324 28141 heartbeater.cc:511] Master 127.2.55.190:39559 requested a full tablet report, sending...
I20260811 16:50:48.128801 27397 ts_manager.cc:194] Registered new tserver with Master: 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097)
I20260811 16:50:48.129196 27397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:56059
I20260811 16:50:48.132079 28147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:48.124957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51758 (local address 127.2.55.190:39559)
0811 16:50:48.125179 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:48.125181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:48.125193 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:50:48.125278 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:48.125279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:48.125292 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:48.125356 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:48.126166 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.126820 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.127962 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.128256 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.128311 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:48.129817 (+ 1506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:48.129818 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:48.129818 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:48.129824 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:48.131118 (+ 1294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:48.131450 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:48.131451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:48.131451 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:48.131511 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:48.131698 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:48.131698 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:48.131699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:48.131791 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:48.131919 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:48.131951 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 16:50:48.132016 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":157,"threads_started":1}
I20260811 16:50:48.132944 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:50:48.135614 28147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:48.133280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51766 (local address 127.2.55.190:39559)
0811 16:50:48.133340 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:48.133342 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:48.133460 (+ 118us) server_negotiation.cc:407] Connection header received
0811 16:50:48.133590 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:48.133591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:48.133648 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:48.133739 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:50:48.133839 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.134275 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.135032 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.135221 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.135273 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:48.135415 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:50:48.135455 (+ 40us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 16:50:48.135573 (+ 118us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51766: token expired
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 16:50:48.135687 28147 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51766: token expired
W20260811 16:50:48.135903 27282 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.55.190:39559)
I20260811 16:50:48.141918 28147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:48.136272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51770 (local address 127.2.55.190:39559)
0811 16:50:48.136306 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:48.136308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:48.136316 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:50:48.136366 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:48.136367 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:48.136373 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:48.136418 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:50:48.136921 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.137342 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.138114 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.138294 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.138347 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:48.139455 (+ 1108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:50:48.139457 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:50:48.139457 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:50:48.139463 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:50:48.140830 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:48.141212 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:48.141212 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:48.141213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:48.141263 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:50:48.141436 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:50:48.141436 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:50:48.141437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:50:48.141558 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:50:48.141635 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:48.141800 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 16:50:48.141861 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 16:50:48.143242 27397 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51770:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:50:48.144932 27397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:50:48.147368 27592 tablet_service.cc:1467] Processing CreateTablet for tablet 7b85a84f56194a9598b88fd442f6873b (DEFAULT_TABLE table=test-table [id=fe22c7cdf8c14c3da2d027a0743211e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:50:48.147591 27592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b85a84f56194a9598b88fd442f6873b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:48.149271 27521 tablet_bootstrap.cc:492] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3: Bootstrap starting.
I20260811 16:50:48.149747 27521 tablet_bootstrap.cc:654] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:48.150584 27521 tablet_bootstrap.cc:492] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3: No bootstrap required, opened a new log
I20260811 16:50:48.150633 27521 ts_tablet_manager.cc:1397] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:50:48.150767 27521 raft_consensus.cc:348] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } }
I20260811 16:50:48.150842 27521 raft_consensus.cc:374] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:48.150895 27521 raft_consensus.cc:729] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f8debf9096243cea1aac54ac826eae3, State: Initialized, Role: FOLLOWER
I20260811 16:50:48.150954 27521 consensus_queue.cc:260] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } }
I20260811 16:50:48.151058 27521 ts_tablet_manager.cc:1428] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:50:48.152019 28149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:48.147217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:33097 (local address 127.0.0.1:37712)
0811 16:50:48.147432 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:48.147444 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:48.147495 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:48.147998 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:48.148000 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:48.148002 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:48.148094 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:48.148096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.149585 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.149586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:48.150780 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:48.150784 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.151715 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.151716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:48.151778 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:48.151783 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:50:48.151839 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 16:50:48.151929 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":41,"thread_start_us":168,"threads_started":1}
I20260811 16:50:48.152019 28151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:48.147557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37712 (local address 127.2.55.131:33097)
0811 16:50:48.147777 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:48.147783 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:48.147798 (+ 15us) server_negotiation.cc:407] Connection header received
0811 16:50:48.147852 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:48.147854 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:48.147884 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:48.147999 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:48.148177 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.149493 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.150890 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.151615 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.151702 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:48.151764 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:48.151895 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 16:50:48.151938 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":143,"threads_started":1}
I20260811 16:50:48.152216 28150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:48.147255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33456 (local address 127.2.55.130:40207)
0811 16:50:48.147852 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:48.147856 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:48.147867 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:50:48.147905 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:48.147907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:48.147924 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:48.148316 (+ 392us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:48.148415 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.149620 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.150843 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.151689 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.151763 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:48.151831 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:48.152090 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 16:50:48.152137 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":105,"threads_started":1}
I20260811 16:50:48.152189 27711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:48.147107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:40207 (local address 127.0.0.1:33456)
0811 16:50:48.147149 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:48.147160 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:48.147198 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:48.148041 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:48.148042 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:48.148044 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:48.148092 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:48.148093 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.149717 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.149719 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:48.150742 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:48.150746 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.151891 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.151892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:48.151961 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:48.151964 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:50:48.152069 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 16:50:48.152117 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21,"mutex_wait_us":2}
I20260811 16:50:48.153234 27817 tablet_service.cc:1467] Processing CreateTablet for tablet 7b85a84f56194a9598b88fd442f6873b (DEFAULT_TABLE table=test-table [id=fe22c7cdf8c14c3da2d027a0743211e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:50:48.153230 28030 tablet_service.cc:1467] Processing CreateTablet for tablet 7b85a84f56194a9598b88fd442f6873b (DEFAULT_TABLE table=test-table [id=fe22c7cdf8c14c3da2d027a0743211e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:50:48.153615 27817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b85a84f56194a9598b88fd442f6873b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:48.153616 28030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b85a84f56194a9598b88fd442f6873b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:50:48.157266 28153 tablet_bootstrap.cc:492] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab: Bootstrap starting.
I20260811 16:50:48.157266 28156 tablet_bootstrap.cc:492] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94: Bootstrap starting.
I20260811 16:50:48.158046 28153 tablet_bootstrap.cc:654] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:48.158046 28156 tablet_bootstrap.cc:654] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94: Neither blocks nor log segments found. Creating new log.
I20260811 16:50:48.158691 28156 log.cc:824] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:48.158735 28153 log.cc:824] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab: Log is configured to *not* fsync() on all Append() calls
I20260811 16:50:48.159554 28153 tablet_bootstrap.cc:492] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab: No bootstrap required, opened a new log
I20260811 16:50:48.159562 28156 tablet_bootstrap.cc:492] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94: No bootstrap required, opened a new log
I20260811 16:50:48.159632 28153 ts_tablet_manager.cc:1397] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:50:48.159632 28156 ts_tablet_manager.cc:1397] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:50:48.161640 28153 raft_consensus.cc:348] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } }
I20260811 16:50:48.161640 28156 raft_consensus.cc:348] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } }
I20260811 16:50:48.161832 28153 raft_consensus.cc:374] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:48.161832 28156 raft_consensus.cc:374] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:50:48.161871 28153 raft_consensus.cc:729] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afbba2075cf4907bd4a44485da57eab, State: Initialized, Role: FOLLOWER
I20260811 16:50:48.161871 28156 raft_consensus.cc:729] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24c7f3bd966e47309aeb94b7dd0cbd94, State: Initialized, Role: FOLLOWER
I20260811 16:50:48.161999 28153 consensus_queue.cc:260] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } }
I20260811 16:50:48.161999 28156 consensus_queue.cc:260] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } }
I20260811 16:50:48.162292 28156 ts_tablet_manager.cc:1428] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 16:50:48.162292 28153 ts_tablet_manager.cc:1428] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:50:48.162325 27923 heartbeater.cc:503] Master 127.2.55.190:39559 was elected leader, sending a full tablet report...
I20260811 16:50:48.162424 28141 heartbeater.cc:503] Master 127.2.55.190:39559 was elected leader, sending a full tablet report...
I20260811 16:50:48.213503 27710 raft_consensus.cc:482] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:50:48.213649 27710 raft_consensus.cc:504] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } }
I20260811 16:50:48.213963 27710 leader_election.cc:288] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207), 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097)
I20260811 16:50:48.217401 28151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:48.214473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:45527 (local address 127.2.55.131:33097)
0811 16:50:48.214525 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:48.214526 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:48.214535 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:50:48.214584 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:48.214585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:48.214595 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:48.214693 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:48.214819 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.215413 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.216565 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.217016 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.217116 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:48.217125 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:48.217306 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 16:50:48.217342 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:50:48.217397 27705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:48.214183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:40207 (local address 127.2.55.129:39193)
0811 16:50:48.214250 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:48.214265 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:48.214326 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:48.214543 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:48.214545 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:48.214548 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:48.214986 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:48.214989 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.215727 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.215728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:48.216436 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:48.216438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.217106 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.217108 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:48.217192 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:48.217196 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:50:48.217241 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 16:50:48.217308 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":4}
I20260811 16:50:48.217397 28150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:48.214324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:39193 (local address 127.2.55.130:40207)
0811 16:50:48.214392 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:48.214394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:48.214402 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:50:48.214431 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:48.214432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:48.214447 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:48.214525 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:50:48.215093 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.215630 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.216534 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.217018 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.217108 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:48.217119 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:48.217274 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 16:50:48.217318 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:50:48.217427 28166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:48.214293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:33097 (local address 127.2.55.129:45527)
0811 16:50:48.214477 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:48.214487 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:50:48.214527 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:50:48.214676 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:50:48.214676 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:50:48.214678 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:50:48.214734 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:48.214736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.215511 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.215513 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:48.216433 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:50:48.216436 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.217146 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.217148 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:50:48.217208 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:48.217211 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:50:48.217289 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 16:50:48.217327 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":115,"threads_started":1}
I20260811 16:50:48.217832 27850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b85a84f56194a9598b88fd442f6873b" candidate_uuid: "0f8debf9096243cea1aac54ac826eae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afbba2075cf4907bd4a44485da57eab" is_pre_election: true
I20260811 16:50:48.217901 28067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b85a84f56194a9598b88fd442f6873b" candidate_uuid: "0f8debf9096243cea1aac54ac826eae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" is_pre_election: true
I20260811 16:50:48.218008 27850 raft_consensus.cc:2454] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f8debf9096243cea1aac54ac826eae3 in term 0.
I20260811 16:50:48.218068 28067 raft_consensus.cc:2454] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f8debf9096243cea1aac54ac826eae3 in term 0.
I20260811 16:50:48.218236 27514 leader_election.cc:302] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0afbba2075cf4907bd4a44485da57eab, 0f8debf9096243cea1aac54ac826eae3; no voters:
I20260811 16:50:48.218369 27710 raft_consensus.cc:2781] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:50:48.218462 27710 raft_consensus.cc:482] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:50:48.218497 27710 raft_consensus.cc:3037] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:48.219278 27710 raft_consensus.cc:504] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } }
I20260811 16:50:48.219427 27710 leader_election.cc:288] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 1 election: Requested vote from peers 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207), 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097)
I20260811 16:50:48.219609 28067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b85a84f56194a9598b88fd442f6873b" candidate_uuid: "0f8debf9096243cea1aac54ac826eae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94"
I20260811 16:50:48.219632 27850 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b85a84f56194a9598b88fd442f6873b" candidate_uuid: "0f8debf9096243cea1aac54ac826eae3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afbba2075cf4907bd4a44485da57eab"
I20260811 16:50:48.219715 28067 raft_consensus.cc:3037] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:48.219718 27850 raft_consensus.cc:3037] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:50:48.220469 27850 raft_consensus.cc:2454] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f8debf9096243cea1aac54ac826eae3 in term 1.
I20260811 16:50:48.220501 28067 raft_consensus.cc:2454] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f8debf9096243cea1aac54ac826eae3 in term 1.
I20260811 16:50:48.220695 27514 leader_election.cc:302] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f8debf9096243cea1aac54ac826eae3, 24c7f3bd966e47309aeb94b7dd0cbd94; no voters:
I20260811 16:50:48.220816 27710 raft_consensus.cc:2781] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:50:48.221031 27710 raft_consensus.cc:686] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 LEADER]: Becoming Leader. State: Replica: 0f8debf9096243cea1aac54ac826eae3, State: Running, Role: LEADER
I20260811 16:50:48.221120 27710 consensus_queue.cc:237] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } }
I20260811 16:50:48.221952 27397 catalog_manager.cc:5495] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f8debf9096243cea1aac54ac826eae3 (127.2.55.129). New cstate: current_term: 1 leader_uuid: "0f8debf9096243cea1aac54ac826eae3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } health_report { overall_health: HEALTHY } } }
W20260811 16:50:48.228968 27926 tablet.cc:2369] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:50:48.243924 27712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:48.241525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34378 (local address 127.2.55.129:42217)
0811 16:50:48.241577 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:50:48.241578 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:50:48.241609 (+ 31us) server_negotiation.cc:407] Connection header received
0811 16:50:48.241682 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:50:48.241683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:50:48.241702 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:50:48.241761 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:50:48.241851 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.242413 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.243150 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:50:48.243364 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:50:48.243420 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:50:48.243641 (+ 221us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:50:48.243739 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:50:48.243793 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:50:48.243845 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 16:50:48.243865 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:50:48.245765 28067 raft_consensus.cc:1261] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 1 FOLLOWER]: Refusing update from remote peer 0f8debf9096243cea1aac54ac826eae3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:50:48.245816 27850 raft_consensus.cc:1261] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab [term 1 FOLLOWER]: Refusing update from remote peer 0f8debf9096243cea1aac54ac826eae3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:50:48.246201 27710 consensus_queue.cc:1035] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:50:48.246347 28167 consensus_queue.cc:1035] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:50:48.248915 28169 mvcc.cc:205] Tried to move back new op lower bound from 7317369029611532288 to 7317369029514276864. Current Snapshot: MvccSnapshot[applied={T|T < 7317369029611532288}]
I20260811 16:50:48.249683 28170 mvcc.cc:205] Tried to move back new op lower bound from 7317369029611532288 to 7317369029514276864. Current Snapshot: MvccSnapshot[applied={T|T < 7317369029611532288 or (T in {7317369029611532288})}]
I20260811 16:50:48.251513 27397 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:50:48.251621 27397 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:50:48.252560 27397 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Sending DeleteTablet for 3 replicas of tablet 7b85a84f56194a9598b88fd442f6873b
I20260811 16:50:48.252909 27592 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b85a84f56194a9598b88fd442f6873b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:50:48 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:34364
I20260811 16:50:48.253005 27713 tablet_replica.cc:330] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3: stopping tablet replica
I20260811 16:50:48.253000 27817 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b85a84f56194a9598b88fd442f6873b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:50:48 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:33456
I20260811 16:50:48.253049 27713 raft_consensus.cc:2229] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:50:48.253054 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 27452
I20260811 16:50:48.253144 27713 raft_consensus.cc:2258] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:50:48.253252 28030 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b85a84f56194a9598b88fd442f6873b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:50:48 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:37712
I20260811 16:50:48.259858 28181 tablet_replica.cc:330] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94: stopping tablet replica
I20260811 16:50:48.260020 28181 raft_consensus.cc:2229] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:50:48.260143 28181 raft_consensus.cc:2258] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:50:48.261258 28181 ts_tablet_manager.cc:1905] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:50:48.263180 28181 ts_tablet_manager.cc:1918] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:50:48.263291 28181 log.cc:1196] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/7b85a84f56194a9598b88fd442f6873b
I20260811 16:50:48.263630 28181 ts_tablet_manager.cc:1939] T 7b85a84f56194a9598b88fd442f6873b P 24c7f3bd966e47309aeb94b7dd0cbd94: Deleting consensus metadata
I20260811 16:50:48.264178 27367 catalog_manager.cc:4841] TS 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097): tablet 7b85a84f56194a9598b88fd442f6873b (table test-table [id=fe22c7cdf8c14c3da2d027a0743211e6]) successfully deleted
I20260811 16:50:48.268188 28180 tablet_replica.cc:330] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab: stopping tablet replica
I20260811 16:50:48.268399 28180 raft_consensus.cc:2229] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:50:48.268743 28180 raft_consensus.cc:2258] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:50:48.269428 28180 ts_tablet_manager.cc:1905] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:50:48.271770 28180 ts_tablet_manager.cc:1918] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:50:48.271867 28180 log.cc:1196] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/7b85a84f56194a9598b88fd442f6873b
I20260811 16:50:48.272179 28180 ts_tablet_manager.cc:1939] T 7b85a84f56194a9598b88fd442f6873b P 0afbba2075cf4907bd4a44485da57eab: Deleting consensus metadata
I20260811 16:50:48.272756 27367 catalog_manager.cc:4841] TS 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207): tablet 7b85a84f56194a9598b88fd442f6873b (table test-table [id=fe22c7cdf8c14c3da2d027a0743211e6]) successfully deleted
W20260811 16:50:48.275841 27369 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.55.129:42217 (error 108)
I20260811 16:50:48.276425 27711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:50:48.276313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:42217 (local address 127.0.0.1:34380)
0811 16:50:48.276355 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 16:50:48.276394 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:42217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 16:50:48.276543 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 27708
W20260811 16:50:48.276604 27369 catalog_manager.cc:4584] TS 0f8debf9096243cea1aac54ac826eae3 (127.2.55.129:42217): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7b85a84f56194a9598b88fd442f6873b: Network error: Client connection negotiation failed: client connection to 127.2.55.129:42217: connect: Connection refused (error 111)
I20260811 16:50:48.287505 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 27928
I20260811 16:50:48.302870 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 27337
I20260811 16:51:08.316538 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:39559
--webserver_interface=127.2.55.190
--webserver_port=34207
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:39559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:08.403429 28183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:08.403641 28183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:08.403664 28183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:08.404780 28183 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 16:51:08.404819 28183 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 16:51:08.404860 28183 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 16:51:08.404872 28183 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:08.404886 28183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:08.404898 28183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:08.404910 28183 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:08.404922 28183 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:08.406456 28183 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:39559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:39559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=34207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:08.406672 28183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:08.406852 28183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:08.412633 28194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:08.412721 28183 server_base.cc:1034] running on GCE node
W20260811 16:51:08.412621 28192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:08.412660 28190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:08.413340 28183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:08.413731 28183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:08.414933 28183 hybrid_clock.cc:648] HybridClock initialized: now 1786467068414909 us; error 41 us; skew 500 ppm
Aug 11 16:51:08 dist-test-slave-3h5h krb5kdc[26417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467068, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:08.418033 28183 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:51:08.418525 28183 webserver.cc:460] Webserver started at http://127.2.55.190:34207/ using document root <none> and password file <none>
I20260811 16:51:08.418792 28183 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:08.418865 28183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:08.420305 28183 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:08.421140 28208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:08.421327 28183 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:08.421440 28183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "2a8912791ba64a9f8f032196d3d5b563"
format_stamp: "Formatted at 2026-08-11 16:50:26 on dist-test-slave-3h5h"
server_key: "2105e77c8900db415d49ce62925bce05"
server_key_iv: "687bbd79e2200648d754cac89b00fbbc"
server_key_version: "encryptionkey@0"
I20260811 16:51:08.421826 28183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:08.432514 28183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:08.434892 28183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:08.435066 28183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:08.439401 28183 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:39559
I20260811 16:51:08.439491 28281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:39559 every 8 connection(s)
I20260811 16:51:08.439865 28183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:08.441495 28282 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:51:08.442306 28282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Bootstrap starting.
I20260811 16:51:08.443929 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 28183
I20260811 16:51:08.444303 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:42217
--local_ip_for_outbound_sockets=127.2.55.129
--tserver_master_addrs=127.2.55.190:39559
--webserver_port=35037
--webserver_interface=127.2.55.129
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:51:08.453297 28282 log.cc:824] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:08.455952 28282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:51:08.456334 28282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Bootstrap complete.
I20260811 16:51:08.459080 28282 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } }
I20260811 16:51:08.459350 28282 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a8912791ba64a9f8f032196d3d5b563, State: Initialized, Role: FOLLOWER
I20260811 16:51:08.459555 28282 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } }
I20260811 16:51:08.459652 28282 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:08.459723 28282 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:08.459775 28282 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:51:08.460958 28282 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } }
I20260811 16:51:08.461076 28282 leader_election.cc:302] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a8912791ba64a9f8f032196d3d5b563; no voters:
I20260811 16:51:08.461304 28282 leader_election.cc:288] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 16:51:08.461347 28288 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:51:08.461520 28288 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [term 3 LEADER]: Becoming Leader. State: Replica: 2a8912791ba64a9f8f032196d3d5b563, State: Running, Role: LEADER
I20260811 16:51:08.461625 28282 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:08.461707 28288 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } }
I20260811 16:51:08.462006 28288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a8912791ba64a9f8f032196d3d5b563. Latest consensus state: current_term: 3 leader_uuid: "2a8912791ba64a9f8f032196d3d5b563" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } } }
I20260811 16:51:08.462110 28288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:08.462013 28289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "2a8912791ba64a9f8f032196d3d5b563" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a8912791ba64a9f8f032196d3d5b563" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39559 } } }
I20260811 16:51:08.462313 28289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:08.462445 28297 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:08.463523 28297 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:08.463727 28297 catalog_manager.cc:1259] Loaded cluster ID: 0042a797a3df43249db0ed02d20b100b
I20260811 16:51:08.463986 28297 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:08.464985 28297 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:08.465193 28297 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Loaded TSK: 0
I20260811 16:51:08.465255 28297 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2a8912791ba64a9f8f032196d3d5b563: Loaded TSK: 1
F20260811 16:51:08.465508 28297 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f391f4a99ad google::LogMessage::Fail() at ??:0
@ 0x7f391f4ac88a google::LogMessage::SendToLog() at ??:0
@ 0x7f391f4a94de google::LogMessage::Flush() at ??:0
@ 0x7f391f4aaa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f3921c16104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f3921c13d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f39274031cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f392740348e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f3927403594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f39273c9c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f39273d3ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f39213770d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f392136c954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f39221d06db start_thread at ??:0
@ 0x7f391dfa761f clone at ??:0
W20260811 16:51:08.577171 28285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:08.577482 28285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:08.577520 28285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:08.579260 28285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:08.579327 28285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:08.579372 28285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:51:08.581631 28285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:42217
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=35037
--tserver_master_addrs=127.2.55.190:39559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:08.581941 28285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:08.582221 28285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:51:08.588020 28285 server_base.cc:1034] running on GCE node
W20260811 16:51:08.588105 28356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:08.587966 28347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:08.587961 28349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:08.588506 28285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:08.588879 28285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:08.590046 28285 hybrid_clock.cc:648] HybridClock initialized: now 1786467068590019 us; error 47 us; skew 500 ppm
Aug 11 16:51:08 dist-test-slave-3h5h krb5kdc[26417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467068, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:08.600287 28285 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:51:08.600876 28285 webserver.cc:460] Webserver started at http://127.2.55.129:35037/ using document root <none> and password file <none>
I20260811 16:51:08.601169 28285 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:08.601220 28285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:08.602634 28285 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:51:08.603396 28365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:08.603591 28285 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:08.603665 28285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "0f8debf9096243cea1aac54ac826eae3"
format_stamp: "Formatted at 2026-08-11 16:50:27 on dist-test-slave-3h5h"
server_key: "b7d0240472617373c2cb26c7a38fa206"
server_key_iv: "52ebd5238aba0438f2dd3eee3b131113"
server_key_version: "encryptionkey@0"
I20260811 16:51:08.604068 28285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:08.612090 28285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:08.614529 28285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:08.614730 28285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:08.614982 28285 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:08.615470 28377 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 16:51:08.617542 28285 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 16:51:08.617632 28285 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 16:51:08.617686 28285 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 16:51:08.618360 28285 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 16:51:08.618396 28285 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 16:51:08.618494 28377 tablet_bootstrap.cc:492] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3: Bootstrap starting.
I20260811 16:51:08.626291 28285 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:42217
I20260811 16:51:08.626442 28554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:42217 every 8 connection(s)
I20260811 16:51:08.626748 28285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:51:08.630482 28377 log.cc:824] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:08.631597 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 28285
I20260811 16:51:08.631894 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:40207
--local_ip_for_outbound_sockets=127.2.55.130
--tserver_master_addrs=127.2.55.190:39559
--webserver_port=39827
--webserver_interface=127.2.55.130
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:51:08.633337 28377 tablet_bootstrap.cc:492] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:51:08.633673 28377 tablet_bootstrap.cc:492] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3: Bootstrap complete.
I20260811 16:51:08.635012 28377 ts_tablet_manager.cc:1397] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.004s
I20260811 16:51:08.636650 28377 raft_consensus.cc:348] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } }
I20260811 16:51:08.637022 28377 raft_consensus.cc:729] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f8debf9096243cea1aac54ac826eae3, State: Initialized, Role: FOLLOWER
I20260811 16:51:08.637185 28377 consensus_queue.cc:260] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } }
I20260811 16:51:08.637485 28377 ts_tablet_manager.cc:1428] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260811 16:51:08.715561 28559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:51:08.627502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:49127)
0811 16:51:08.627771 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:08.627812 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:08.628265 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:08.715339 (+ 87074us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":105,"threads_started":1}
W20260811 16:51:08.715881 28555 heartbeater.cc:644] Failed to heartbeat to 127.2.55.190:39559 (0 consecutive failures): Network error: Failed to ping master at 127.2.55.190:39559: Client connection negotiation failed: client connection to 127.2.55.190:39559: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 16:51:08.716326 28559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:08.716188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:54145)
0811 16:51:08.716251 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:08.716303 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 16:51:08.716761 28559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:08.716667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:44327)
0811 16:51:08.716720 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:08.716744 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 16:51:08.716914 28555 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:51:08.728467 28561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:08.728677 28561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:08.728710 28561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:08.729954 28561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:08.730000 28561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:08.730058 28561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:51:08.731570 28561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:40207
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=39827
--tserver_master_addrs=127.2.55.190:39559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:08.731829 28561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:08.732074 28561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:08.737403 28567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:08.737407 28569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:08.737522 28561 server_base.cc:1034] running on GCE node
W20260811 16:51:08.737407 28573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:08.737911 28561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:08.738174 28561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:08.739349 28561 hybrid_clock.cc:648] HybridClock initialized: now 1786467068739325 us; error 41 us; skew 500 ppm
Aug 11 16:51:08 dist-test-slave-3h5h krb5kdc[26417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467068, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:08.741991 28561 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:51:08.742501 28561 webserver.cc:460] Webserver started at http://127.2.55.130:39827/ using document root <none> and password file <none>
I20260811 16:51:08.742738 28561 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:08.742784 28561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:08.744167 28561 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:08.744808 28586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:08.745009 28561 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:08.745115 28561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "0afbba2075cf4907bd4a44485da57eab"
format_stamp: "Formatted at 2026-08-11 16:50:27 on dist-test-slave-3h5h"
server_key: "7262b25d8839c6365bec7767ecbe6828"
server_key_iv: "6ef904cc143358c550d7dc38030b3dd3"
server_key_version: "encryptionkey@0"
I20260811 16:51:08.745491 28561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:08.757755 28561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:08.759972 28561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:08.760150 28561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:08.760442 28561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:08.760776 28561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:08.760833 28561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:08.760902 28561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:08.760927 28561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:08.768380 28561 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:40207
I20260811 16:51:08.768430 28766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:40207 every 8 connection(s)
I20260811 16:51:08.768885 28561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:51:08.770033 28772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:08.769639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:48977)
0811 16:51:08.769808 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:08.769888 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":85,"threads_started":1}
W20260811 16:51:08.770494 28768 heartbeater.cc:644] Failed to heartbeat to 127.2.55.190:39559 (0 consecutive failures): Network error: Failed to ping master at 127.2.55.190:39559: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
I20260811 16:51:08.770848 28772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:08.770753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:55763)
0811 16:51:08.770802 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:08.770830 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 16:51:08.771108 28772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:08.771059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:54921)
0811 16:51:08.771079 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:08.771097 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260811 16:51:08.771236 28768 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 16:51:08.771464 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 28561
I20260811 16:51:08.771793 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:33097
--local_ip_for_outbound_sockets=127.2.55.131
--tserver_master_addrs=127.2.55.190:39559
--webserver_port=41197
--webserver_interface=127.2.55.131
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:08.878844 28775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:08.879173 28775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:08.879228 28775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:08.881520 28775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:08.881603 28775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:08.881657 28775 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:51:08.884433 28775 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:33097
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=41197
--tserver_master_addrs=127.2.55.190:39559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28775
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:08.884755 28775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:08.885083 28775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:08.891001 28783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:08.891001 28784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:08.891055 28786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:08.891376 28775 server_base.cc:1034] running on GCE node
I20260811 16:51:08.891655 28775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:08.891952 28775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:08.893112 28775 hybrid_clock.cc:648] HybridClock initialized: now 1786467068893097 us; error 34 us; skew 500 ppm
Aug 11 16:51:08 dist-test-slave-3h5h krb5kdc[26417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467068, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:08.895979 28775 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:51:08.896514 28775 webserver.cc:460] Webserver started at http://127.2.55.131:41197/ using document root <none> and password file <none>
I20260811 16:51:08.896795 28775 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:08.896896 28775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:08.898463 28775 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:51:08.899363 28800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:08.899607 28775 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:51:08.899709 28775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "24c7f3bd966e47309aeb94b7dd0cbd94"
format_stamp: "Formatted at 2026-08-11 16:50:27 on dist-test-slave-3h5h"
server_key: "bead3e7e0bb431ac24b315df1ed37cef"
server_key_iv: "5d34bc0b3db64d5660c8caa4e7061e2f"
server_key_version: "encryptionkey@0"
I20260811 16:51:08.900103 28775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:08.935117 28775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:08.937661 28775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:08.937866 28775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:08.938161 28775 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:08.938510 28775 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:08.938568 28775 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:08.938611 28775 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:08.938629 28775 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:08.944983 28775 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:33097
I20260811 16:51:08.945036 28974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:33097 every 8 connection(s)
I20260811 16:51:08.945412 28775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:51:08.946619 28979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:08.946203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:54731)
0811 16:51:08.946387 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:08.946465 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":87,"threads_started":1}
W20260811 16:51:08.947072 28975 heartbeater.cc:644] Failed to heartbeat to 127.2.55.190:39559 (0 consecutive failures): Network error: Failed to ping master at 127.2.55.190:39559: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
I20260811 16:51:08.947396 28979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:08.947302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:36389)
0811 16:51:08.947349 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:08.947377 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 16:51:08.947697 28979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:08.947615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:57753)
0811 16:51:08.947662 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:08.947683 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 16:51:08.947821 28975 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 16:51:08.948794 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 28775
I20260811 16:51:09.717703 28987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:09.717423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:54927)
0811 16:51:09.717577 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:09.717631 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":69,"threads_started":1}
I20260811 16:51:09.771797 28988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:09.771582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:36159)
0811 16:51:09.771709 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:09.771746 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":61,"threads_started":1}
I20260811 16:51:09.948536 28990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:09.948191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:47319)
0811 16:51:09.948358 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:09.948441 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":61,"threads_started":1}
I20260811 16:51:10.406631 28991 raft_consensus.cc:482] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:51:10.406821 28991 raft_consensus.cc:504] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } }
I20260811 16:51:10.407266 28991 leader_election.cc:288] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207), 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097)
Aug 11 16:51:10 dist-test-slave-3h5h krb5kdc[26417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467068, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.131@KRBTEST.COM
Aug 11 16:51:10 dist-test-slave-3h5h krb5kdc[26417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467068, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.130@KRBTEST.COM
I20260811 16:51:10.421463 28992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:10.407464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:40207 (local address 127.2.55.129:53535)
0811 16:51:10.407606 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:10.407620 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:10.407697 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:10.408714 (+ 1017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:10.408718 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:10.409292 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:10.409574 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:10.409582 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:10.411287 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:10.411289 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:10.412604 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:10.412607 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:10.413484 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:10.413485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:10.413619 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:10.414421 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:51:10.414427 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:10.416597 (+ 2170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:10.419261 (+ 2664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:10.419273 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:10.419275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:10.419773 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:10.420081 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:10.420082 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:10.420082 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:10.420258 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:10.420770 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:10.420780 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:10.421050 (+ 270us) client_negotiation.cc:769] Sending connection context
0811 16:51:10.421127 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 16:51:10.421339 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":93,"thread_start_us":87,"threads_started":1}
I20260811 16:51:10.421518 28993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:10.407568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:53535 (local address 127.2.55.130:40207)
0811 16:51:10.407748 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:10.407760 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:10.407787 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:51:10.408427 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:10.408430 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:10.408487 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:10.408656 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:10.409725 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:10.411142 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:10.412744 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:10.413369 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:10.413488 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:10.416777 (+ 3289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:10.416780 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:10.416781 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:10.416791 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:10.419149 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:10.419875 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:10.419878 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:10.419879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:10.420006 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:10.420340 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:10.420341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:10.420342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:10.420678 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:10.420769 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:10.421251 (+ 482us) server_negotiation.cc:299] Negotiation successful
0811 16:51:10.421401 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":83,"threads_started":1}
I20260811 16:51:10.421518 29000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:10.407853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:48877 (local address 127.2.55.131:33097)
0811 16:51:10.408000 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:10.408008 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:10.408044 (+ 36us) server_negotiation.cc:407] Connection header received
0811 16:51:10.408635 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:10.408638 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:10.408681 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:10.408806 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:10.409719 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:10.411142 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:10.412708 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:10.413369 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:10.413488 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:10.416262 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:10.416266 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:10.416266 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:10.416278 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:10.419135 (+ 2857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:10.419875 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:10.419878 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:10.419879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:10.420001 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:10.420341 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:10.420341 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:10.420342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:10.420678 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:10.420769 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:10.421251 (+ 482us) server_negotiation.cc:299] Negotiation successful
0811 16:51:10.421401 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
I20260811 16:51:10.421489 28994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:10.407702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:33097 (local address 127.2.55.129:48877)
0811 16:51:10.407818 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:10.407830 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:10.407877 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:10.408814 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:10.408815 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:10.409291 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:10.409574 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:10.409582 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:10.411301 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:10.411302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:10.412604 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:10.412607 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:10.413483 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:10.413485 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:10.413619 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:10.414364 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:51:10.414376 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:10.416119 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:10.419261 (+ 3142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:10.419273 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:10.419275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:10.419773 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:10.420151 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:10.420152 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:10.420152 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:10.420258 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:10.420770 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:10.420780 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:10.420979 (+ 199us) client_negotiation.cc:769] Sending connection context
0811 16:51:10.421121 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 16:51:10.421396 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":190,"thread_start_us":66,"threads_started":1}
W20260811 16:51:10.422645 28367 leader_election.cc:341] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207): Not found: Tablet not found: 7b85a84f56194a9598b88fd442f6873b
W20260811 16:51:10.422732 28367 leader_election.cc:341] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097): Not found: Tablet not found: 7b85a84f56194a9598b88fd442f6873b
I20260811 16:51:10.422750 28367 leader_election.cc:302] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f8debf9096243cea1aac54ac826eae3; no voters: 0afbba2075cf4907bd4a44485da57eab, 24c7f3bd966e47309aeb94b7dd0cbd94
I20260811 16:51:10.422860 28991 raft_consensus.cc:2726] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:51:10.718444 28994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:10.718267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:44671)
0811 16:51:10.718370 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:10.718404 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 16:51:10.772493 29002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:10.772270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:37865)
0811 16:51:10.772398 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:10.772447 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":62,"threads_started":1}
I20260811 16:51:10.949376 29003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:10.949127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:43533)
0811 16:51:10.949290 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:10.949331 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":87,"threads_started":1}
I20260811 16:51:11.719261 29004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:11.718981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:60445)
0811 16:51:11.719162 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:11.719207 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":68,"threads_started":1}
I20260811 16:51:11.773244 29005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:11.773023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:44311)
0811 16:51:11.773155 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:11.773195 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":66,"threads_started":1}
I20260811 16:51:11.950117 29007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:11.949878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:38923)
0811 16:51:11.950033 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:11.950074 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":64,"threads_started":1}
I20260811 16:51:12.644618 29008 raft_consensus.cc:482] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:51:12.644721 29008 raft_consensus.cc:504] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } }
I20260811 16:51:12.644945 29008 leader_election.cc:288] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207), 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097)
W20260811 16:51:12.645488 28367 leader_election.cc:341] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097): Not found: Tablet not found: 7b85a84f56194a9598b88fd442f6873b
W20260811 16:51:12.645596 28367 leader_election.cc:341] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207): Not found: Tablet not found: 7b85a84f56194a9598b88fd442f6873b
I20260811 16:51:12.645615 28367 leader_election.cc:302] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f8debf9096243cea1aac54ac826eae3; no voters: 0afbba2075cf4907bd4a44485da57eab, 24c7f3bd966e47309aeb94b7dd0cbd94
I20260811 16:51:12.645681 29008 raft_consensus.cc:2726] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:51:12.720116 29010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:12.719819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:53695)
0811 16:51:12.720001 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:12.720048 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":66,"threads_started":1}
I20260811 16:51:12.774005 29014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:12.773743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:48233)
0811 16:51:12.773894 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:12.773941 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":83,"threads_started":1}
I20260811 16:51:12.950866 29015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:12.950610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:43523)
0811 16:51:12.950745 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:12.950784 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":67,"threads_started":1}
I20260811 16:51:13.721026 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:13.720725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:46003)
0811 16:51:13.720933 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:13.720976 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":75,"threads_started":1}
I20260811 16:51:13.774781 29017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:13.774531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:59443)
0811 16:51:13.774669 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:13.774733 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":65,"threads_started":1}
I20260811 16:51:13.951678 29018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:13.951419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:35399)
0811 16:51:13.951579 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:13.951624 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":87,"threads_started":1}
I20260811 16:51:14.721784 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:14.721568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:44603)
0811 16:51:14.721702 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:14.721735 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":67,"threads_started":1}
I20260811 16:51:14.775596 29021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:14.775381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:47023)
0811 16:51:14.775512 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:14.775548 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
I20260811 16:51:14.952421 29022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:14.952172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:40689)
0811 16:51:14.952332 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:14.952375 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":67,"threads_started":1}
I20260811 16:51:15.414980 29025 raft_consensus.cc:482] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:51:15.415108 29025 raft_consensus.cc:504] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } }
I20260811 16:51:15.415271 29025 leader_election.cc:288] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207), 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097)
W20260811 16:51:15.415730 28367 leader_election.cc:341] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097): Not found: Tablet not found: 7b85a84f56194a9598b88fd442f6873b
W20260811 16:51:15.415797 28367 leader_election.cc:341] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207): Not found: Tablet not found: 7b85a84f56194a9598b88fd442f6873b
I20260811 16:51:15.415812 28367 leader_election.cc:302] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f8debf9096243cea1aac54ac826eae3; no voters: 0afbba2075cf4907bd4a44485da57eab, 24c7f3bd966e47309aeb94b7dd0cbd94
I20260811 16:51:15.415890 29025 raft_consensus.cc:2726] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:51:15.722749 29026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:15.722478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:54611)
0811 16:51:15.722642 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:15.722700 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":94,"threads_started":1}
I20260811 16:51:15.776427 29027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:15.776186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:55181)
0811 16:51:15.776336 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:15.776378 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":78,"threads_started":1}
I20260811 16:51:15.953387 29029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:15.953138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:33263)
0811 16:51:15.953298 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:15.953341 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":100,"threads_started":1}
I20260811 16:51:16.723474 29031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:16.723227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:41843)
0811 16:51:16.723375 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:16.723425 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":64,"threads_started":1}
I20260811 16:51:16.777287 29033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:16.777018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:53987)
0811 16:51:16.777185 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:16.777238 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":72,"threads_started":1}
I20260811 16:51:16.954080 29034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:16.953865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:37195)
0811 16:51:16.953991 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:16.954032 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":63,"threads_started":1}
I20260811 16:51:17.724354 29035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:17.724070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:48103)
0811 16:51:17.724257 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:17.724301 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":110,"threads_started":1}
I20260811 16:51:17.778209 29039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:17.777871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:41311)
0811 16:51:17.778108 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:17.778157 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":64,"threads_started":1}
I20260811 16:51:17.954896 29040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:17.954618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:60699)
0811 16:51:17.954801 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:17.954846 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":87,"threads_started":1}
I20260811 16:51:18.017513 29042 raft_consensus.cc:482] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:51:18.017624 29042 raft_consensus.cc:504] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } }
I20260811 16:51:18.017835 29042 leader_election.cc:288] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207), 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097)
W20260811 16:51:18.018301 28367 leader_election.cc:341] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097): Not found: Tablet not found: 7b85a84f56194a9598b88fd442f6873b
W20260811 16:51:18.018404 28367 leader_election.cc:341] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207): Not found: Tablet not found: 7b85a84f56194a9598b88fd442f6873b
I20260811 16:51:18.018440 28367 leader_election.cc:302] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f8debf9096243cea1aac54ac826eae3; no voters: 0afbba2075cf4907bd4a44485da57eab, 24c7f3bd966e47309aeb94b7dd0cbd94
I20260811 16:51:18.018530 29042 raft_consensus.cc:2726] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:51:18.725256 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:18.725038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:48179)
0811 16:51:18.725170 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:18.725205 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":65,"threads_started":1}
I20260811 16:51:18.778992 29045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:18.778776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:52391)
0811 16:51:18.778908 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:18.778941 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":69,"threads_started":1}
I20260811 16:51:18.955750 29047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:18.955461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:34231)
0811 16:51:18.955653 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:18.955702 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":92,"threads_started":1}
I20260811 16:51:19.726154 29048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:19.725869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:50691)
0811 16:51:19.726050 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:19.726103 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":90,"threads_started":1}
I20260811 16:51:19.779773 29049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:19.779510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:43393)
0811 16:51:19.779675 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:19.779721 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":93,"threads_started":1}
I20260811 16:51:19.906945 29050 raft_consensus.cc:482] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:51:19.907043 29050 raft_consensus.cc:504] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0afbba2075cf4907bd4a44485da57eab" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 40207 } } peers { permanent_uuid: "24c7f3bd966e47309aeb94b7dd0cbd94" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 33097 } } peers { permanent_uuid: "0f8debf9096243cea1aac54ac826eae3" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42217 } }
I20260811 16:51:19.907254 29050 leader_election.cc:288] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207), 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097)
W20260811 16:51:19.907706 28367 leader_election.cc:341] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0afbba2075cf4907bd4a44485da57eab (127.2.55.130:40207): Not found: Tablet not found: 7b85a84f56194a9598b88fd442f6873b
W20260811 16:51:19.907814 28367 leader_election.cc:341] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 24c7f3bd966e47309aeb94b7dd0cbd94 (127.2.55.131:33097): Not found: Tablet not found: 7b85a84f56194a9598b88fd442f6873b
I20260811 16:51:19.907855 28367 leader_election.cc:302] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f8debf9096243cea1aac54ac826eae3; no voters: 0afbba2075cf4907bd4a44485da57eab, 24c7f3bd966e47309aeb94b7dd0cbd94
I20260811 16:51:19.907912 29050 raft_consensus.cc:2726] T 7b85a84f56194a9598b88fd442f6873b P 0f8debf9096243cea1aac54ac826eae3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:51:19.956593 29052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:19.956333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:55457)
0811 16:51:19.956496 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:19.956541 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":71,"threads_started":1}
I20260811 16:51:20.727080 29055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:20.726732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:37915)
0811 16:51:20.726927 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:20.726986 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":69,"threads_started":1}
I20260811 16:51:20.780603 29056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:20.780285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:47265)
0811 16:51:20.780494 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:20.780551 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":152,"threads_started":1}
I20260811 16:51:20.957433 29057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:20.957187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:60091)
0811 16:51:20.957338 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:20.957381 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":71,"threads_started":1}
I20260811 16:51:21.728056 29058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:21.727735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:34515)
0811 16:51:21.727914 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:21.727980 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":110,"threads_started":1}
I20260811 16:51:21.781311 29059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:21.781069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:39793)
0811 16:51:21.781226 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:21.781262 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":89,"threads_started":1}
I20260811 16:51:21.958456 29060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:21.958174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:46115)
0811 16:51:21.958358 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:21.958404 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":68,"threads_started":1}
I20260811 16:51:22.728888 29061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:22.728574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:55343)
0811 16:51:22.728729 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:22.728783 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":81,"threads_started":1}
I20260811 16:51:22.782104 29063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:22.781840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:51433)
0811 16:51:22.782020 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:22.782055 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":114,"threads_started":1}
I20260811 16:51:22.959244 29064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:22.958979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:49923)
0811 16:51:22.959153 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:22.959189 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":88,"threads_started":1}
I20260811 16:51:23.729755 29065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:23.729522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.129:59661)
0811 16:51:23.729668 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:23.729708 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":92,"threads_started":1}
I20260811 16:51:23.783017 29066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:23.782764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.130:49187)
0811 16:51:23.782921 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:23.782967 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":85,"threads_started":1}
I20260811 16:51:23.955526 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 28285
I20260811 16:51:23.963171 29069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:23.962107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:39559 (local address 127.2.55.131:34961)
0811 16:51:23.963060 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:23.963104 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.190:39559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":932,"thread_start_us":881,"threads_started":1}
I20260811 16:51:23.968458 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 28561
I20260811 16:51:23.979673 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 28775
2026-08-11T16:51:23Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58938 ms)
[----------] 30 tests from SecurityITest (248308 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:24 dist-test-slave-3h5h krb5kdc[29074](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:24 dist-test-slave-3h5h krb5kdc[29074](info): set up 2 sockets
Aug 11 16:51:24 dist-test-slave-3h5h krb5kdc[29074](info): commencing operation
krb5kdc: starting...
W20260811 16:51:25.346267 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.336s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:25 dist-test-slave-3h5h krb5kdc[29074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:51:25.476416 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:34771
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:40753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:34771
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:25.561964 29099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:25.562191 29099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:25.562216 29099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:25.563313 29099 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:25.563349 29099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:25.563362 29099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:25.563375 29099 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:25.563387 29099 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:25.564797 29099 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:40753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:34771
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:34771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:25.565138 29099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:25.565388 29099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:25.570935 29106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:25.570991 29099 server_base.cc:1034] running on GCE node
W20260811 16:51:25.570966 29109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:25.570969 29105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:25.571367 29099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:25.571718 29099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:25.572906 29099 hybrid_clock.cc:648] HybridClock initialized: now 1786467085572868 us; error 43 us; skew 500 ppm
Aug 11 16:51:25 dist-test-slave-3h5h krb5kdc[29074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467085, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:25.575569 29099 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:51:25.576092 29099 webserver.cc:460] Webserver started at http://127.2.55.190:45491/ using document root <none> and password file <none>
I20260811 16:51:25.576331 29099 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:25.576378 29099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:25.576535 29099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:25.577756 29099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "e3af3f9406d34ee28b2e613d8c72fc03"
format_stamp: "Formatted at 2026-08-11 16:51:25 on dist-test-slave-3h5h"
server_key: "80dd48a8b24477d2e2f5743abe0c499e"
server_key_iv: "5a55c192ba233f7e2852fd8f7177597b"
server_key_version: "encryptionkey@0"
I20260811 16:51:25.578145 29099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "e3af3f9406d34ee28b2e613d8c72fc03"
format_stamp: "Formatted at 2026-08-11 16:51:25 on dist-test-slave-3h5h"
server_key: "80dd48a8b24477d2e2f5743abe0c499e"
server_key_iv: "5a55c192ba233f7e2852fd8f7177597b"
server_key_version: "encryptionkey@0"
I20260811 16:51:25.579560 29099 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:51:25.580343 29117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:25.580511 29099 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:51:25.580611 29099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "e3af3f9406d34ee28b2e613d8c72fc03"
format_stamp: "Formatted at 2026-08-11 16:51:25 on dist-test-slave-3h5h"
server_key: "80dd48a8b24477d2e2f5743abe0c499e"
server_key_iv: "5a55c192ba233f7e2852fd8f7177597b"
server_key_version: "encryptionkey@0"
I20260811 16:51:25.580670 29099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:25.591898 29099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:25.594105 29099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:25.594290 29099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:25.598783 29099 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:34771
I20260811 16:51:25.598862 29205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:34771 every 8 connection(s)
I20260811 16:51:25.599249 29099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:25.600227 29207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:25.602398 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 29099
I20260811 16:51:25.602514 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:25.602733 2270 external_mini_cluster.cc:1428] Setting key aaf76282986e5df8c8df5e10942663b4
I20260811 16:51:25.603164 29207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03: Bootstrap starting.
I20260811 16:51:25.603937 29207 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:25.604308 29207 log.cc:824] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:25.605208 29207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03: No bootstrap required, opened a new log
I20260811 16:51:25.607496 29207 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3af3f9406d34ee28b2e613d8c72fc03" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 34771 } }
I20260811 16:51:25.607676 29207 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:25.607751 29207 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3af3f9406d34ee28b2e613d8c72fc03, State: Initialized, Role: FOLLOWER
I20260811 16:51:25.607926 29207 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3af3f9406d34ee28b2e613d8c72fc03" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 34771 } }
I20260811 16:51:25.608027 29207 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:25.608428 29207 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:25.608498 29207 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:25.609401 29207 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3af3f9406d34ee28b2e613d8c72fc03" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 34771 } }
I20260811 16:51:25.609534 29207 leader_election.cc:302] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3af3f9406d34ee28b2e613d8c72fc03; no voters:
I20260811 16:51:25.609761 29207 leader_election.cc:288] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:25.609789 29212 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:25.609911 29212 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [term 1 LEADER]: Becoming Leader. State: Replica: e3af3f9406d34ee28b2e613d8c72fc03, State: Running, Role: LEADER
I20260811 16:51:25.610055 29207 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:25.610070 29212 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3af3f9406d34ee28b2e613d8c72fc03" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 34771 } }
Aug 11 16:51:25 dist-test-slave-3h5h krb5kdc[29074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:51:25.610396 29212 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3af3f9406d34ee28b2e613d8c72fc03. Latest consensus state: current_term: 1 leader_uuid: "e3af3f9406d34ee28b2e613d8c72fc03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3af3f9406d34ee28b2e613d8c72fc03" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 34771 } } }
I20260811 16:51:25.610482 29212 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:25.610699 29225 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:25.610857 29214 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3af3f9406d34ee28b2e613d8c72fc03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3af3f9406d34ee28b2e613d8c72fc03" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 34771 } } }
I20260811 16:51:25.611011 29214 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:25.611296 29225 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:25.613106 29225 catalog_manager.cc:1347] Generated new cluster ID: b1d888b52c074464aacfc6bc4febc589
I20260811 16:51:25.613168 29225 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:25.614828 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:25.603346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33822 (local address 127.2.55.190:34771)
0811 16:51:25.603540 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:25.603548 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:25.603577 (+ 29us) server_negotiation.cc:407] Connection header received
0811 16:51:25.604019 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:25.604026 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:25.604121 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:25.604249 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:25.605051 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:25.606052 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:25.607260 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:25.607666 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:25.607817 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:25.610851 (+ 3034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:25.610856 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:25.610856 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:25.610869 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:25.613252 (+ 2383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:25.613663 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:25.613666 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:25.613667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:25.613777 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:25.614004 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:25.614005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:25.614005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:25.614260 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:25.614439 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:25.614512 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 16:51:25.614656 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":99,"threads_started":1}
I20260811 16:51:25.623948 29225 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:25.624513 29225 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:25.628334 29225 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03: Generated new TSK 0
I20260811 16:51:25.628512 29225 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:51:25.660332 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:34771
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:40753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:25.765946 29248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:25.766227 29248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:25.766274 29248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:25.767622 29248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:25.767709 29248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:25.767757 29248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:51:25.769418 29248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:40753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:34771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:25.769702 29248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:25.769950 29248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:25.775559 29254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:25.775559 29256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:25.775604 29258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:25.775836 29248 server_base.cc:1034] running on GCE node
I20260811 16:51:25.776057 29248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:25.776357 29248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:25.777520 29248 hybrid_clock.cc:648] HybridClock initialized: now 1786467085777502 us; error 29 us; skew 500 ppm
Aug 11 16:51:25 dist-test-slave-3h5h krb5kdc[29074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467085, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:25.780135 29248 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:51:25.780658 29248 webserver.cc:460] Webserver started at http://127.2.55.129:42523/ using document root <none> and password file <none>
I20260811 16:51:25.780944 29248 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:25.780995 29248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:25.781088 29248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:25.782156 29248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "cc748e58913b412c9951a6ecb2943aef"
format_stamp: "Formatted at 2026-08-11 16:51:25 on dist-test-slave-3h5h"
server_key: "bef807054b4452a3cc4ca738b44466b5"
server_key_iv: "9daf023efa771da6410744bb611686e3"
server_key_version: "encryptionkey@0"
I20260811 16:51:25.782469 29248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "cc748e58913b412c9951a6ecb2943aef"
format_stamp: "Formatted at 2026-08-11 16:51:25 on dist-test-slave-3h5h"
server_key: "bef807054b4452a3cc4ca738b44466b5"
server_key_iv: "9daf023efa771da6410744bb611686e3"
server_key_version: "encryptionkey@0"
I20260811 16:51:25.784089 29248 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:51:25.784981 29269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:25.785247 29248 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:25.785355 29248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "cc748e58913b412c9951a6ecb2943aef"
format_stamp: "Formatted at 2026-08-11 16:51:25 on dist-test-slave-3h5h"
server_key: "bef807054b4452a3cc4ca738b44466b5"
server_key_iv: "9daf023efa771da6410744bb611686e3"
server_key_version: "encryptionkey@0"
I20260811 16:51:25.785420 29248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:25.814496 29248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:25.817319 29248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:25.817493 29248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:25.817739 29248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:25.818189 29248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:25.818235 29248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:25.818262 29248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:25.818324 29248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:25.824944 29248 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:45515
I20260811 16:51:25.825021 29439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:45515 every 8 connection(s)
I20260811 16:51:25.825457 29248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:51:25.827996 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 29248
I20260811 16:51:25.828140 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:51:25.828363 2270 external_mini_cluster.cc:1428] Setting key 94d22d2f616e7889e6668d129e6e4c9f
Aug 11 16:51:25 dist-test-slave-3h5h krb5kdc[29074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467085, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:51:25.837733 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:25.826419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:53741 (local address 127.2.55.190:34771)
0811 16:51:25.826513 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:25.826516 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:25.826748 (+ 232us) server_negotiation.cc:407] Connection header received
0811 16:51:25.827247 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:25.827248 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:25.827259 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:25.827321 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:25.828734 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:25.829492 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:25.831169 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:25.831529 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:25.831619 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:25.834278 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:25.834280 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:25.834281 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:25.834292 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:25.835943 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:25.836507 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:25.836508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:25.836509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:25.836570 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:25.836937 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:25.836938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:25.836938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:25.837065 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:25.837138 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:25.837556 (+ 418us) server_negotiation.cc:299] Negotiation successful
0811 16:51:25.837657 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 16:51:25.838050 29443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:25.826380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:34771 (local address 127.2.55.129:53741)
0811 16:51:25.826593 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:25.826635 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:25.827153 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:25.827378 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:25.827381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:25.828298 (+ 917us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:25.828607 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:25.828614 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:25.829599 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:25.829601 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:25.831035 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:25.831039 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:25.831634 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:25.831636 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:25.831745 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:25.832335 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:51:25.832345 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:25.834093 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:25.836045 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:25.836056 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:25.836060 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:25.836414 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:25.836661 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:25.836663 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:25.836663 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:25.836826 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:25.837153 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:25.837161 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:25.837360 (+ 199us) client_negotiation.cc:769] Sending connection context
0811 16:51:25.837510 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 16:51:25.837709 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":112,"threads_started":1}
I20260811 16:51:25.838660 29440 heartbeater.cc:347] Connected to a master server at 127.2.55.190:34771
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
I20260811 16:51:25.838785 29440 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:25.838985 29440 heartbeater.cc:511] Master 127.2.55.190:34771 requested a full tablet report, sending...
I20260811 16:51:25.839572 29141 ts_manager.cc:194] Registered new tserver with Master: cc748e58913b412c9951a6ecb2943aef (127.2.55.129:45515)
I20260811 16:51:25.840416 29141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:53741
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:51:25.860524 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:34771
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:40753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:25.950280 29448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:25.950511 29448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:25.950537 29448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:25.951674 29448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:25.951714 29448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:25.951741 29448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:51:25.953195 29448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:40753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:34771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:25.953394 29448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:25.953581 29448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:25.959009 29453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:25.959040 29454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:25.959219 29448 server_base.cc:1034] running on GCE node
W20260811 16:51:25.959372 29458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:25.959649 29448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:25.959918 29448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:25.961181 29448 hybrid_clock.cc:648] HybridClock initialized: now 1786467085961161 us; error 29 us; skew 500 ppm
Aug 11 16:51:25 dist-test-slave-3h5h krb5kdc[29074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467085, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:25.964080 29448 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:51:25.964605 29448 webserver.cc:460] Webserver started at http://127.2.55.130:44827/ using document root <none> and password file <none>
I20260811 16:51:25.964933 29448 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:25.965027 29448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:25.965206 29448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:25.966408 29448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "e83caa6da7e54ba8bd3eb47374f3013f"
format_stamp: "Formatted at 2026-08-11 16:51:25 on dist-test-slave-3h5h"
server_key: "cc32d540555ec9c6f110acb2c3b8e658"
server_key_iv: "a8a613f5cbb54dd7bce102e31070802b"
server_key_version: "encryptionkey@0"
I20260811 16:51:25.966853 29448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "e83caa6da7e54ba8bd3eb47374f3013f"
format_stamp: "Formatted at 2026-08-11 16:51:25 on dist-test-slave-3h5h"
server_key: "cc32d540555ec9c6f110acb2c3b8e658"
server_key_iv: "a8a613f5cbb54dd7bce102e31070802b"
server_key_version: "encryptionkey@0"
I20260811 16:51:25.968453 29448 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:51:25.969480 29469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:25.969730 29448 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:51:25.969847 29448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "e83caa6da7e54ba8bd3eb47374f3013f"
format_stamp: "Formatted at 2026-08-11 16:51:25 on dist-test-slave-3h5h"
server_key: "cc32d540555ec9c6f110acb2c3b8e658"
server_key_iv: "a8a613f5cbb54dd7bce102e31070802b"
server_key_version: "encryptionkey@0"
I20260811 16:51:25.969936 29448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:25.980106 29448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:25.982237 29448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:25.982410 29448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:25.982662 29448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:25.982986 29448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:25.983072 29448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:25.983144 29448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:25.983186 29448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:25.990016 29448 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:33893
I20260811 16:51:25.990170 29643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:33893 every 8 connection(s)
I20260811 16:51:25.990454 29448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:51:25 dist-test-slave-3h5h krb5kdc[29074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467085, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:51:25.997375 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 29448
I20260811 16:51:25.997502 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:51:25.997750 2270 external_mini_cluster.cc:1428] Setting key e618ff6a7f74e3ecdb3a8698e992cc72
I20260811 16:51:26.000772 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:25.991292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:54709 (local address 127.2.55.190:34771)
0811 16:51:25.991459 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:25.991462 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:25.991512 (+ 50us) server_negotiation.cc:407] Connection header received
0811 16:51:25.992057 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:25.992058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:25.992073 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:25.992136 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:25.993269 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:25.993803 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:25.994834 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:25.995041 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:25.995136 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:25.997443 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:25.997445 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:25.997445 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:25.997454 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:25.999349 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:25.999760 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:25.999761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:25.999761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:25.999830 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:26.000067 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:26.000068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:26.000069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:26.000223 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:26.000295 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:26.000584 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 16:51:26.000673 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260811 16:51:26.001027 29651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:25.991206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:34771 (local address 127.2.55.130:54709)
0811 16:51:25.991378 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:25.991423 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:25.991922 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:25.992229 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:25.992234 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:25.992898 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:25.993160 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:25.993165 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:25.993910 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:25.993912 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:25.994730 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:25.994732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:25.995170 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:25.995171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:25.995296 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:25.995867 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:51:25.995876 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:25.997333 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:25.999438 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:25.999445 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:25.999447 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:25.999679 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:25.999900 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:25.999900 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:25.999901 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:26.000000 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:26.000294 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:26.000299 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:26.000419 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 16:51:26.000541 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 16:51:26.000744 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":98,"threads_started":1}
I20260811 16:51:26.001641 29647 heartbeater.cc:347] Connected to a master server at 127.2.55.190:34771
I20260811 16:51:26.001768 29647 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:26.002004 29647 heartbeater.cc:511] Master 127.2.55.190:34771 requested a full tablet report, sending...
I20260811 16:51:26.002439 29141 ts_manager.cc:194] Registered new tserver with Master: e83caa6da7e54ba8bd3eb47374f3013f (127.2.55.130:33893)
I20260811 16:51:26.003041 29141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:54709
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:51:26.029218 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:34771
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:40753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:26.116386 29654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:26.116602 29654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:26.116626 29654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:26.117801 29654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:26.117848 29654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:26.117875 29654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:51:26.119299 29654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:40753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:34771
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:26.119496 29654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:26.119671 29654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:26.124895 29667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:26.124920 29664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:26.124892 29662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:26.125449 29654 server_base.cc:1034] running on GCE node
I20260811 16:51:26.125697 29654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:26.125928 29654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:26.127140 29654 hybrid_clock.cc:648] HybridClock initialized: now 1786467086127120 us; error 35 us; skew 500 ppm
Aug 11 16:51:26 dist-test-slave-3h5h krb5kdc[29074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467086, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:26.130143 29654 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:51:26.130725 29654 webserver.cc:460] Webserver started at http://127.2.55.131:40021/ using document root <none> and password file <none>
I20260811 16:51:26.131075 29654 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:26.131166 29654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:26.131318 29654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:26.132476 29654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "5f77225569624599bf3dbead5159731f"
format_stamp: "Formatted at 2026-08-11 16:51:26 on dist-test-slave-3h5h"
server_key: "c5d8546b0dba4943a3e7c5e949c0adeb"
server_key_iv: "17572589975c4b18bb14e30916cb8dbd"
server_key_version: "encryptionkey@0"
I20260811 16:51:26.132977 29654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "5f77225569624599bf3dbead5159731f"
format_stamp: "Formatted at 2026-08-11 16:51:26 on dist-test-slave-3h5h"
server_key: "c5d8546b0dba4943a3e7c5e949c0adeb"
server_key_iv: "17572589975c4b18bb14e30916cb8dbd"
server_key_version: "encryptionkey@0"
I20260811 16:51:26.134481 29654 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:26.135352 29676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:26.135574 29654 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:26.135684 29654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "5f77225569624599bf3dbead5159731f"
format_stamp: "Formatted at 2026-08-11 16:51:26 on dist-test-slave-3h5h"
server_key: "c5d8546b0dba4943a3e7c5e949c0adeb"
server_key_iv: "17572589975c4b18bb14e30916cb8dbd"
server_key_version: "encryptionkey@0"
I20260811 16:51:26.135771 29654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:26.152053 29654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:26.154304 29654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:26.154493 29654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:26.154778 29654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:26.155174 29654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:26.155221 29654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:26.155247 29654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:26.155289 29654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:26.162163 29654 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:35397
I20260811 16:51:26.162215 29857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:35397 every 8 connection(s)
I20260811 16:51:26.162578 29654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:51:26.165951 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 29654
I20260811 16:51:26.166121 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:51:26.166330 2270 external_mini_cluster.cc:1428] Setting key eff27e412790636989cdefc363ea87c1
Aug 11 16:51:26 dist-test-slave-3h5h krb5kdc[29074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467086, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:51:26.173619 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.163304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:47773 (local address 127.2.55.190:34771)
0811 16:51:26.163355 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:26.163357 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:26.163587 (+ 230us) server_negotiation.cc:407] Connection header received
0811 16:51:26.164152 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:26.164153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:26.164165 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:26.164426 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:26.165617 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.166439 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.167773 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.167961 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.168024 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.170556 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:26.170557 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:26.170558 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:26.170565 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:26.172120 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:26.172539 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:26.172540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:26.172541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:26.172593 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:26.173032 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:26.173033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:26.173033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:26.173143 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:26.173213 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:26.173483 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 16:51:26.173554 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:51:26.173856 29860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.163268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:34771 (local address 127.2.55.131:47773)
0811 16:51:26.163456 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:26.163504 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:26.164051 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:26.164495 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:26.164499 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:26.165293 (+ 794us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:26.165502 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:26.165508 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.166574 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.166575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:26.167687 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:26.167690 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.168087 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.168087 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:26.168199 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.168698 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:51:26.168708 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:26.170442 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:26.172206 (+ 1764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:26.172213 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:26.172215 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:26.172459 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:26.172656 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:26.172657 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:26.172657 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:26.172762 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:26.173216 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:26.173223 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:26.173353 (+ 130us) client_negotiation.cc:769] Sending connection context
0811 16:51:26.173442 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 16:51:26.173605 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":104,"threads_started":1}
I20260811 16:51:26.174585 29858 heartbeater.cc:347] Connected to a master server at 127.2.55.190:34771
I20260811 16:51:26.174711 29858 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:26.174908 29858 heartbeater.cc:511] Master 127.2.55.190:34771 requested a full tablet report, sending...
I20260811 16:51:26.175359 29141 ts_manager.cc:194] Registered new tserver with Master: 5f77225569624599bf3dbead5159731f (127.2.55.131:35397)
I20260811 16:51:26.175753 29141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:47773
I20260811 16:51:26.178393 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:51:26.186115 29210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.179834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33838 (local address 127.2.55.190:34771)
0811 16:51:26.179888 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:26.179890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:26.180012 (+ 122us) server_negotiation.cc:407] Connection header received
0811 16:51:26.180071 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:26.180072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:26.180081 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:26.180125 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:26.180739 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.181278 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.182124 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.182306 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.182357 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.183680 (+ 1323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:26.183682 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:26.183682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:26.183690 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:26.185146 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:26.185465 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:26.185466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:26.185466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:26.185517 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:26.185689 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:26.185689 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:26.185690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:26.185828 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:26.185908 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:26.185992 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 16:51:26.186050 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 16:51:26.187706 29141 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33838:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:51:26.189565 29141 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:51:26.196663 29883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.192386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38784 (local address 127.2.55.130:33893)
0811 16:51:26.192626 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:26.192632 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:26.192877 (+ 245us) server_negotiation.cc:407] Connection header received
0811 16:51:26.193151 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:26.193154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:26.193168 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:26.193223 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:26.193455 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.194151 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.195620 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.196214 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.196308 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.196374 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:26.196521 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 16:51:26.196574 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":101,"threads_started":1}
I20260811 16:51:26.196749 29884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.192462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58680 (local address 127.2.55.131:35397)
0811 16:51:26.192739 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:26.192743 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:26.192826 (+ 83us) server_negotiation.cc:407] Connection header received
0811 16:51:26.193136 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:26.193140 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:26.193158 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:26.193240 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:26.193418 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.194170 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.195679 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.196398 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.196477 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.196532 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:26.196625 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 16:51:26.196666 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":75,"threads_started":1}
I20260811 16:51:26.196942 29879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.192262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:33893 (local address 127.0.0.1:38784)
0811 16:51:26.192777 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:26.192788 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:26.193050 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:26.193338 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:26.193338 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:26.193341 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:26.193392 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:26.193394 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.194302 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.194303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:26.195524 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:26.195527 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.196308 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.196309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:26.196390 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.196406 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 16:51:26.196802 (+ 396us) client_negotiation.cc:240] Negotiation successful
0811 16:51:26.196885 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"mutex_wait_us":76,"thread_start_us":88,"threads_started":1}
I20260811 16:51:26.197216 29885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.192262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:35397 (local address 127.0.0.1:58680)
0811 16:51:26.192697 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:26.192756 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:26.192862 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:26.193247 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:26.193250 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:26.193253 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:26.193336 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:26.193338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.194287 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.194288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:26.195586 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:26.195589 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.196481 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.196482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:26.196541 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.196544 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:51:26.196595 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 16:51:26.196654 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":29,"thread_start_us":64,"threads_started":1}
I20260811 16:51:26.197767 29546 tablet_service.cc:1467] Processing CreateTablet for tablet 03ac34bb729545d6ac38e7673bec2bf1 (DEFAULT_TABLE table=test-table [id=764060dfee8f40b388cbda95a7bfe8bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:26.198012 29880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.192539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:45515 (local address 127.0.0.1:60504)
0811 16:51:26.192939 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:26.192948 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:26.192994 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:26.193282 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:26.193283 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:26.193284 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:26.193336 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:26.193337 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.195644 (+ 2307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.195645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:26.196722 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:26.196725 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.197759 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.197760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:26.197821 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.197825 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:51:26.197887 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 16:51:26.197925 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"mutex_wait_us":4,"thread_start_us":88,"threads_started":1}
I20260811 16:51:26.198052 29886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.192818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60504 (local address 127.2.55.129:45515)
0811 16:51:26.193040 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:26.193044 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:26.193054 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:51:26.193096 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:26.193099 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:26.193116 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:26.193196 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:26.194330 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.195526 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.196827 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.197598 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.197667 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.197720 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:26.197919 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 16:51:26.197969 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":104,"threads_started":1}
I20260811 16:51:26.198194 29546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ac34bb729545d6ac38e7673bec2bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:26.198119 29750 tablet_service.cc:1467] Processing CreateTablet for tablet 03ac34bb729545d6ac38e7673bec2bf1 (DEFAULT_TABLE table=test-table [id=764060dfee8f40b388cbda95a7bfe8bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:26.198429 29750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ac34bb729545d6ac38e7673bec2bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:26.201226 29888 tablet_bootstrap.cc:492] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f: Bootstrap starting.
I20260811 16:51:26.201586 29331 tablet_service.cc:1467] Processing CreateTablet for tablet 03ac34bb729545d6ac38e7673bec2bf1 (DEFAULT_TABLE table=test-table [id=764060dfee8f40b388cbda95a7bfe8bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:26.201812 29890 tablet_bootstrap.cc:492] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f: Bootstrap starting.
I20260811 16:51:26.201921 29888 tablet_bootstrap.cc:654] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:26.201979 29331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ac34bb729545d6ac38e7673bec2bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:26.202538 29890 tablet_bootstrap.cc:654] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:26.202561 29888 log.cc:824] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:26.203079 29890 log.cc:824] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:26.203478 29888 tablet_bootstrap.cc:492] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f: No bootstrap required, opened a new log
I20260811 16:51:26.203526 29888 ts_tablet_manager.cc:1397] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:51:26.203938 29890 tablet_bootstrap.cc:492] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f: No bootstrap required, opened a new log
I20260811 16:51:26.203999 29890 ts_tablet_manager.cc:1397] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:51:26.205497 29893 tablet_bootstrap.cc:492] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef: Bootstrap starting.
I20260811 16:51:26.205578 29888 raft_consensus.cc:348] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f77225569624599bf3dbead5159731f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35397 } } peers { permanent_uuid: "e83caa6da7e54ba8bd3eb47374f3013f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33893 } } peers { permanent_uuid: "cc748e58913b412c9951a6ecb2943aef" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45515 } }
I20260811 16:51:26.205765 29888 raft_consensus.cc:374] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:26.205801 29888 raft_consensus.cc:729] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f77225569624599bf3dbead5159731f, State: Initialized, Role: FOLLOWER
I20260811 16:51:26.205929 29888 consensus_queue.cc:260] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f77225569624599bf3dbead5159731f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35397 } } peers { permanent_uuid: "e83caa6da7e54ba8bd3eb47374f3013f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33893 } } peers { permanent_uuid: "cc748e58913b412c9951a6ecb2943aef" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45515 } }
I20260811 16:51:26.206070 29890 raft_consensus.cc:348] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f77225569624599bf3dbead5159731f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35397 } } peers { permanent_uuid: "e83caa6da7e54ba8bd3eb47374f3013f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33893 } } peers { permanent_uuid: "cc748e58913b412c9951a6ecb2943aef" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45515 } }
I20260811 16:51:26.206233 29888 ts_tablet_manager.cc:1428] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:51:26.206246 29890 raft_consensus.cc:374] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:26.206249 29893 tablet_bootstrap.cc:654] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:26.206280 29890 raft_consensus.cc:729] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83caa6da7e54ba8bd3eb47374f3013f, State: Initialized, Role: FOLLOWER
I20260811 16:51:26.206357 29858 heartbeater.cc:503] Master 127.2.55.190:34771 was elected leader, sending a full tablet report...
I20260811 16:51:26.206719 29890 consensus_queue.cc:260] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f77225569624599bf3dbead5159731f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35397 } } peers { permanent_uuid: "e83caa6da7e54ba8bd3eb47374f3013f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33893 } } peers { permanent_uuid: "cc748e58913b412c9951a6ecb2943aef" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45515 } }
I20260811 16:51:26.206930 29893 log.cc:824] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:26.207012 29890 ts_tablet_manager.cc:1428] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:51:26.207157 29647 heartbeater.cc:503] Master 127.2.55.190:34771 was elected leader, sending a full tablet report...
I20260811 16:51:26.208011 29893 tablet_bootstrap.cc:492] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef: No bootstrap required, opened a new log
I20260811 16:51:26.208112 29893 ts_tablet_manager.cc:1397] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:51:26.209659 29893 raft_consensus.cc:348] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f77225569624599bf3dbead5159731f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35397 } } peers { permanent_uuid: "e83caa6da7e54ba8bd3eb47374f3013f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33893 } } peers { permanent_uuid: "cc748e58913b412c9951a6ecb2943aef" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45515 } }
I20260811 16:51:26.209792 29893 raft_consensus.cc:374] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:26.209815 29893 raft_consensus.cc:729] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc748e58913b412c9951a6ecb2943aef, State: Initialized, Role: FOLLOWER
I20260811 16:51:26.209935 29893 consensus_queue.cc:260] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f77225569624599bf3dbead5159731f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35397 } } peers { permanent_uuid: "e83caa6da7e54ba8bd3eb47374f3013f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33893 } } peers { permanent_uuid: "cc748e58913b412c9951a6ecb2943aef" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45515 } }
I20260811 16:51:26.210253 29893 ts_tablet_manager.cc:1428] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 16:51:26.210330 29440 heartbeater.cc:503] Master 127.2.55.190:34771 was elected leader, sending a full tablet report...
W20260811 16:51:26.241032 29649 tablet.cc:2369] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:51:26.326342 29441 tablet.cc:2369] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:51:26.413221 29859 tablet.cc:2369] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:51:26.511896 29899 raft_consensus.cc:482] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:51:26.512045 29899 raft_consensus.cc:504] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f77225569624599bf3dbead5159731f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35397 } } peers { permanent_uuid: "e83caa6da7e54ba8bd3eb47374f3013f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33893 } } peers { permanent_uuid: "cc748e58913b412c9951a6ecb2943aef" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45515 } }
I20260811 16:51:26.512432 29899 leader_election.cc:288] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f77225569624599bf3dbead5159731f (127.2.55.131:35397), e83caa6da7e54ba8bd3eb47374f3013f (127.2.55.130:33893)
I20260811 16:51:26.515547 29901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.512658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:35397 (local address 127.2.55.129:33553)
0811 16:51:26.512874 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:26.512885 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:26.512948 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:26.513111 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:26.513113 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:26.513115 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:26.513200 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:26.513202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.513873 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.513875 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:26.514647 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:26.514649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.515252 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.515253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:26.515330 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.515334 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:51:26.515414 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 16:51:26.515456 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":65,"threads_started":1}
I20260811 16:51:26.515532 29884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.512812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:33553 (local address 127.2.55.131:35397)
0811 16:51:26.512923 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:26.512926 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:26.512935 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:51:26.513015 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:26.513016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:26.513027 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:26.513108 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:26.513278 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.513783 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.514757 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.515139 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.515247 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.515257 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:26.515423 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 16:51:26.515460 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 16:51:26.515839 29900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.512635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:33893 (local address 127.2.55.129:42853)
0811 16:51:26.512802 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:26.512814 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:26.512922 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:26.513193 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:26.513194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:26.513197 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:26.513293 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:26.513294 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.514032 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.514033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:26.514852 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:26.514854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.515471 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.515472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:26.515559 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.515563 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:51:26.515687 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 16:51:26.515738 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":97,"threads_started":1}
I20260811 16:51:26.515869 29883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.512749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:42853 (local address 127.2.55.130:33893)
0811 16:51:26.512805 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:26.512807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:26.512918 (+ 111us) server_negotiation.cc:407] Connection header received
0811 16:51:26.512989 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:26.513069 (+ 80us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:26.513103 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:26.513187 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:26.513381 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.513912 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.514963 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.515360 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.515456 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.515465 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:26.515729 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 16:51:26.515787 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:51:26.515882 29788 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03ac34bb729545d6ac38e7673bec2bf1" candidate_uuid: "cc748e58913b412c9951a6ecb2943aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f77225569624599bf3dbead5159731f" is_pre_election: true
I20260811 16:51:26.516106 29788 raft_consensus.cc:2454] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc748e58913b412c9951a6ecb2943aef in term 0.
I20260811 16:51:26.516122 29577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03ac34bb729545d6ac38e7673bec2bf1" candidate_uuid: "cc748e58913b412c9951a6ecb2943aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83caa6da7e54ba8bd3eb47374f3013f" is_pre_election: true
I20260811 16:51:26.516321 29577 raft_consensus.cc:2454] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc748e58913b412c9951a6ecb2943aef in term 0.
I20260811 16:51:26.516404 29272 leader_election.cc:302] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f77225569624599bf3dbead5159731f, cc748e58913b412c9951a6ecb2943aef; no voters:
I20260811 16:51:26.516561 29899 raft_consensus.cc:2781] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:51:26.516635 29899 raft_consensus.cc:482] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:51:26.516660 29899 raft_consensus.cc:3037] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:26.517494 29899 raft_consensus.cc:504] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f77225569624599bf3dbead5159731f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35397 } } peers { permanent_uuid: "e83caa6da7e54ba8bd3eb47374f3013f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33893 } } peers { permanent_uuid: "cc748e58913b412c9951a6ecb2943aef" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45515 } }
I20260811 16:51:26.517652 29899 leader_election.cc:288] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [CANDIDATE]: Term 1 election: Requested vote from peers 5f77225569624599bf3dbead5159731f (127.2.55.131:35397), e83caa6da7e54ba8bd3eb47374f3013f (127.2.55.130:33893)
I20260811 16:51:26.517853 29788 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03ac34bb729545d6ac38e7673bec2bf1" candidate_uuid: "cc748e58913b412c9951a6ecb2943aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f77225569624599bf3dbead5159731f"
I20260811 16:51:26.517886 29577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03ac34bb729545d6ac38e7673bec2bf1" candidate_uuid: "cc748e58913b412c9951a6ecb2943aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83caa6da7e54ba8bd3eb47374f3013f"
I20260811 16:51:26.517951 29577 raft_consensus.cc:3037] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:26.517944 29788 raft_consensus.cc:3037] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:26.518898 29577 raft_consensus.cc:2454] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc748e58913b412c9951a6ecb2943aef in term 1.
I20260811 16:51:26.518896 29788 raft_consensus.cc:2454] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc748e58913b412c9951a6ecb2943aef in term 1.
I20260811 16:51:26.519207 29272 leader_election.cc:302] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f77225569624599bf3dbead5159731f, cc748e58913b412c9951a6ecb2943aef; no voters:
I20260811 16:51:26.519371 29899 raft_consensus.cc:2781] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:26.519591 29899 raft_consensus.cc:686] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [term 1 LEADER]: Becoming Leader. State: Replica: cc748e58913b412c9951a6ecb2943aef, State: Running, Role: LEADER
I20260811 16:51:26.519721 29899 consensus_queue.cc:237] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f77225569624599bf3dbead5159731f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35397 } } peers { permanent_uuid: "e83caa6da7e54ba8bd3eb47374f3013f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33893 } } peers { permanent_uuid: "cc748e58913b412c9951a6ecb2943aef" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45515 } }
I20260811 16:51:26.520761 29138 catalog_manager.cc:5495] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef reported cstate change: term changed from 0 to 1, leader changed from <none> to cc748e58913b412c9951a6ecb2943aef (127.2.55.129). New cstate: current_term: 1 leader_uuid: "cc748e58913b412c9951a6ecb2943aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f77225569624599bf3dbead5159731f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83caa6da7e54ba8bd3eb47374f3013f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc748e58913b412c9951a6ecb2943aef" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45515 } health_report { overall_health: HEALTHY } } }
I20260811 16:51:26.551292 29886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.548691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60512 (local address 127.2.55.129:45515)
0811 16:51:26.548780 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:26.548782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:26.548791 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:51:26.548883 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:26.548884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:26.548911 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:26.548991 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:51:26.549198 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.549697 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.550494 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.550693 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.550747 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.550891 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:51:26.550992 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:51:26.551054 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:26.551138 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 16:51:26.551158 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 16:51:26.553490 29577 raft_consensus.cc:1261] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f [term 1 FOLLOWER]: Refusing update from remote peer cc748e58913b412c9951a6ecb2943aef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:51:26.553507 29788 raft_consensus.cc:1261] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f [term 1 FOLLOWER]: Refusing update from remote peer cc748e58913b412c9951a6ecb2943aef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:51:26.553908 29902 consensus_queue.cc:1035] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f77225569624599bf3dbead5159731f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:51:26.554073 29899 consensus_queue.cc:1035] T 03ac34bb729545d6ac38e7673bec2bf1 P cc748e58913b412c9951a6ecb2943aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83caa6da7e54ba8bd3eb47374f3013f" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 33893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:51:26.557904 29910 mvcc.cc:205] Tried to move back new op lower bound from 7317369186519138304 to 7317369186385440768. Current Snapshot: MvccSnapshot[applied={T|T < 7317369186519138304 or (T in {7317369186519138304})}]
I20260811 16:51:26.558053 29913 mvcc.cc:205] Tried to move back new op lower bound from 7317369186519138304 to 7317369186385440768. Current Snapshot: MvccSnapshot[applied={T|T < 7317369186519138304 or (T in {7317369186519138304})}]
I20260811 16:51:26.559062 29138 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:51:26.559170 29138 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:51:26.560015 29138 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e3af3f9406d34ee28b2e613d8c72fc03: Sending DeleteTablet for 3 replicas of tablet 03ac34bb729545d6ac38e7673bec2bf1
I20260811 16:51:26.560356 29750 tablet_service.cc:1514] Processing DeleteTablet for tablet 03ac34bb729545d6ac38e7673bec2bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:26 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:58680
I20260811 16:51:26.560380 29331 tablet_service.cc:1514] Processing DeleteTablet for tablet 03ac34bb729545d6ac38e7673bec2bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:26 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:60504
I20260811 16:51:26.560511 29546 tablet_service.cc:1514] Processing DeleteTablet for tablet 03ac34bb729545d6ac38e7673bec2bf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:26 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:38784
I20260811 16:51:26.560739 29924 tablet_replica.cc:330] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f: stopping tablet replica
I20260811 16:51:26.560851 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 29248
I20260811 16:51:26.560912 29924 raft_consensus.cc:2229] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:51:26.561501 29924 raft_consensus.cc:2258] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:51:26.564129 29924 ts_tablet_manager.cc:1905] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:51:26.566731 29924 ts_tablet_manager.cc:1918] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:51:26.566819 29924 log.cc:1196] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/03ac34bb729545d6ac38e7673bec2bf1
I20260811 16:51:26.567168 29924 ts_tablet_manager.cc:1939] T 03ac34bb729545d6ac38e7673bec2bf1 P e83caa6da7e54ba8bd3eb47374f3013f: Deleting consensus metadata
I20260811 16:51:26.569087 29122 catalog_manager.cc:4841] TS e83caa6da7e54ba8bd3eb47374f3013f (127.2.55.130:33893): tablet 03ac34bb729545d6ac38e7673bec2bf1 (table test-table [id=764060dfee8f40b388cbda95a7bfe8bb]) successfully deleted
I20260811 16:51:26.572355 29922 tablet_replica.cc:330] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f: stopping tablet replica
I20260811 16:51:26.572461 29922 raft_consensus.cc:2229] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:51:26.572561 29922 raft_consensus.cc:2258] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:51:26.573127 29922 ts_tablet_manager.cc:1905] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:51:26.574870 29922 ts_tablet_manager.cc:1918] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:51:26.574967 29922 log.cc:1196] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/03ac34bb729545d6ac38e7673bec2bf1
I20260811 16:51:26.575302 29922 ts_tablet_manager.cc:1939] T 03ac34bb729545d6ac38e7673bec2bf1 P 5f77225569624599bf3dbead5159731f: Deleting consensus metadata
I20260811 16:51:26.575778 29121 catalog_manager.cc:4841] TS 5f77225569624599bf3dbead5159731f (127.2.55.131:35397): tablet 03ac34bb729545d6ac38e7673bec2bf1 (table test-table [id=764060dfee8f40b388cbda95a7bfe8bb]) successfully deleted
W20260811 16:51:26.578477 29121 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.55.129:45515 (error 108)
I20260811 16:51:26.579063 29880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.578890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:45515 (local address 127.0.0.1:60526)
0811 16:51:26.578955 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:26.579006 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:45515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 16:51:26.579166 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 29448
W20260811 16:51:26.579216 29121 catalog_manager.cc:4584] TS cc748e58913b412c9951a6ecb2943aef (127.2.55.129:45515): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 03ac34bb729545d6ac38e7673bec2bf1: Network error: Client connection negotiation failed: client connection to 127.2.55.129:45515: connect: Connection refused (error 111)
I20260811 16:51:26.591158 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 29654
I20260811 16:51:26.602538 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 29099
2026-08-11T16:51:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2619 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T16:51:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:26Z Disabled control of system clock
I20260811 16:51:26.639488 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:42411
--webserver_interface=127.2.55.190
--webserver_port=0
--builtin_ntp_servers=127.2.55.148:42259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:42411
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:51:26.729279 29931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:26.729646 29931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:26.729696 29931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:26.730895 29931 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:26.730937 29931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:26.730950 29931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:26.730963 29931 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:26.731032 29931 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:26.732457 29931 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:42259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:42411
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:42411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29931
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:26.732683 29931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:26.732966 29931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:26.738441 29944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:26.738495 29931 server_base.cc:1034] running on GCE node
W20260811 16:51:26.738466 29942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:26.738647 29941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:26.738942 29931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:26.739317 29931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:26.740556 29931 hybrid_clock.cc:648] HybridClock initialized: now 1786467086740541 us; error 53 us; skew 500 ppm
I20260811 16:51:26.741998 29931 webserver.cc:460] Webserver started at http://127.2.55.190:44557/ using document root <none> and password file <none>
I20260811 16:51:26.742362 29931 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:26.742453 29931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:26.742637 29931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:26.744113 29931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "12faa3d5fb8748c3b21fe6c35a4bdc4f"
format_stamp: "Formatted at 2026-08-11 16:51:26 on dist-test-slave-3h5h"
server_key: "2f060c02789ab481ddc2f13c8d7da8a6"
server_key_iv: "aa95a629b4063c232bfcb4a56d218fde"
server_key_version: "encryptionkey@0"
I20260811 16:51:26.744535 29931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "12faa3d5fb8748c3b21fe6c35a4bdc4f"
format_stamp: "Formatted at 2026-08-11 16:51:26 on dist-test-slave-3h5h"
server_key: "2f060c02789ab481ddc2f13c8d7da8a6"
server_key_iv: "aa95a629b4063c232bfcb4a56d218fde"
server_key_version: "encryptionkey@0"
I20260811 16:51:26.746198 29931 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 16:51:26.747221 29952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:26.747560 29931 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:26.747695 29931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "12faa3d5fb8748c3b21fe6c35a4bdc4f"
format_stamp: "Formatted at 2026-08-11 16:51:26 on dist-test-slave-3h5h"
server_key: "2f060c02789ab481ddc2f13c8d7da8a6"
server_key_iv: "aa95a629b4063c232bfcb4a56d218fde"
server_key_version: "encryptionkey@0"
I20260811 16:51:26.747789 29931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:26.764644 29931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:26.765143 29931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:26.765350 29931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:26.770128 29931 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:42411
I20260811 16:51:26.770169 30025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:42411 every 8 connection(s)
I20260811 16:51:26.770599 29931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:26.771723 30026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:26.774436 30026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f: Bootstrap starting.
I20260811 16:51:26.775041 30026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:26.775313 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 29931
I20260811 16:51:26.775449 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:26.775430 30026 log.cc:824] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:26.775692 2270 external_mini_cluster.cc:1428] Setting key 052c262852b09eabf7e8db16a757828c
I20260811 16:51:26.776440 30026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f: No bootstrap required, opened a new log
I20260811 16:51:26.779667 30026 raft_consensus.cc:348] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12faa3d5fb8748c3b21fe6c35a4bdc4f" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42411 } }
I20260811 16:51:26.779853 30026 raft_consensus.cc:374] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:26.779884 30026 raft_consensus.cc:729] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12faa3d5fb8748c3b21fe6c35a4bdc4f, State: Initialized, Role: FOLLOWER
I20260811 16:51:26.780014 30026 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12faa3d5fb8748c3b21fe6c35a4bdc4f" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42411 } }
I20260811 16:51:26.780131 30026 raft_consensus.cc:388] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:26.780197 30026 raft_consensus.cc:482] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:26.780254 30026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:26.780941 30026 raft_consensus.cc:504] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12faa3d5fb8748c3b21fe6c35a4bdc4f" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42411 } }
I20260811 16:51:26.781065 30026 leader_election.cc:302] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12faa3d5fb8748c3b21fe6c35a4bdc4f; no voters:
I20260811 16:51:26.781237 30026 leader_election.cc:288] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:26.781301 30036 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:26.781458 30036 raft_consensus.cc:686] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [term 1 LEADER]: Becoming Leader. State: Replica: 12faa3d5fb8748c3b21fe6c35a4bdc4f, State: Running, Role: LEADER
I20260811 16:51:26.781515 30026 sys_catalog.cc:564] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:26.781549 30036 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12faa3d5fb8748c3b21fe6c35a4bdc4f" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42411 } }
I20260811 16:51:26.781881 30036 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12faa3d5fb8748c3b21fe6c35a4bdc4f. Latest consensus state: current_term: 1 leader_uuid: "12faa3d5fb8748c3b21fe6c35a4bdc4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12faa3d5fb8748c3b21fe6c35a4bdc4f" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42411 } } }
I20260811 16:51:26.781972 30036 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:26.781891 30037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "12faa3d5fb8748c3b21fe6c35a4bdc4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12faa3d5fb8748c3b21fe6c35a4bdc4f" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42411 } } }
I20260811 16:51:26.782125 30037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:26.782594 30052 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:26.783174 30052 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:26.783653 30033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.776333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58668 (local address 127.2.55.190:42411)
0811 16:51:26.776622 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:26.776633 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:26.776672 (+ 39us) server_negotiation.cc:407] Connection header received
0811 16:51:26.777892 (+ 1220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:26.777902 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:26.777991 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:26.778164 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:26.778351 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.779985 (+ 1634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.780941 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.781652 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.782204 (+ 552us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.782617 (+ 413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:26.782621 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:26.782621 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:26.782885 (+ 264us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:26.782926 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:26.782942 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:26.783209 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:26.783298 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 16:51:26.783379 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":111,"threads_started":1}
I20260811 16:51:26.785295 30052 catalog_manager.cc:1347] Generated new cluster ID: fcc3d7c05bde4b6eb7f05c0c01bd632c
I20260811 16:51:26.785353 30052 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:26.812760 30052 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:26.813536 30052 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:26.818354 30052 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f: Generated new TSK 0
I20260811 16:51:26.818635 30052 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:26.829416 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42411
--builtin_ntp_servers=127.2.55.148:42259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:51:26.913180 30068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:26.913435 30068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:26.913477 30068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:26.915133 30068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:26.915238 30068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:26.915290 30068 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:51:26.916949 30068 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:42259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:26.917243 30068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:26.917573 30068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:26.924077 30077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:26.924189 30078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:26.924077 30080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:26.924635 30068 server_base.cc:1034] running on GCE node
I20260811 16:51:26.924955 30068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:26.925195 30068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:26.926343 30068 hybrid_clock.cc:648] HybridClock initialized: now 1786467086926331 us; error 32 us; skew 500 ppm
I20260811 16:51:26.927850 30068 webserver.cc:460] Webserver started at http://127.2.55.129:45117/ using document root <none> and password file <none>
I20260811 16:51:26.928144 30068 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:26.928226 30068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:26.928387 30068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:26.929582 30068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "8f827891ed434980af78a2910b4b2aa5"
format_stamp: "Formatted at 2026-08-11 16:51:26 on dist-test-slave-3h5h"
server_key: "f2e5395998da57c59aef9c7095a24f3a"
server_key_iv: "0381d52078e7e6f37cea7433dca12675"
server_key_version: "encryptionkey@0"
I20260811 16:51:26.929993 30068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "8f827891ed434980af78a2910b4b2aa5"
format_stamp: "Formatted at 2026-08-11 16:51:26 on dist-test-slave-3h5h"
server_key: "f2e5395998da57c59aef9c7095a24f3a"
server_key_iv: "0381d52078e7e6f37cea7433dca12675"
server_key_version: "encryptionkey@0"
I20260811 16:51:26.931438 30068 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:51:26.932272 30090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:26.932477 30068 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:26.932614 30068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "8f827891ed434980af78a2910b4b2aa5"
format_stamp: "Formatted at 2026-08-11 16:51:26 on dist-test-slave-3h5h"
server_key: "f2e5395998da57c59aef9c7095a24f3a"
server_key_iv: "0381d52078e7e6f37cea7433dca12675"
server_key_version: "encryptionkey@0"
I20260811 16:51:26.932698 30068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:26.951702 30068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:26.952064 30068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:26.952234 30068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:26.952499 30068 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:26.952986 30068 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:26.953055 30068 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:26.953092 30068 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:26.953120 30068 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:26.959810 30068 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:43943
I20260811 16:51:26.959954 30268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:43943 every 8 connection(s)
I20260811 16:51:26.960284 30068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:51:26.965641 30033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.961144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:41675 (local address 127.2.55.190:42411)
0811 16:51:26.961229 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:26.961231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:26.961468 (+ 237us) server_negotiation.cc:407] Connection header received
0811 16:51:26.961948 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:26.961949 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:26.961963 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:26.962015 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:26.962717 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.963245 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.964221 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.964428 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.964484 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.965323 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:26.965324 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:26.965325 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:26.965329 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:26.965343 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:26.965347 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:26.965393 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:26.965557 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 16:51:26.965579 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 16:51:26.965991 30272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:26.961115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:42411 (local address 127.2.55.129:41675)
0811 16:51:26.961333 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:26.961369 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:26.961860 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:26.962074 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:26.962077 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:26.962085 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:26.962617 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:26.962621 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.963338 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.963339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:26.964135 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:26.964137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:26.964513 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:26.964514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:26.964624 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:26.965187 (+ 563us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:51:26.965187 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:26.965215 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:51:26.965238 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:26.965453 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:26.965462 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:26.965465 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:51:26.965547 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 16:51:26.965636 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":114,"threads_started":1}
I20260811 16:51:26.966045 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 30068
I20260811 16:51:26.966156 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:51:26.966399 2270 external_mini_cluster.cc:1428] Setting key d8cf1373b2f07defb0c5b65abf886510
I20260811 16:51:26.966928 30269 heartbeater.cc:347] Connected to a master server at 127.2.55.190:42411
I20260811 16:51:26.967038 30269 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:26.967284 30269 heartbeater.cc:511] Master 127.2.55.190:42411 requested a full tablet report, sending...
I20260811 16:51:26.967675 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42411
--builtin_ntp_servers=127.2.55.148:42259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 16:51:26.968001 29979 ts_manager.cc:194] Registered new tserver with Master: 8f827891ed434980af78a2910b4b2aa5 (127.2.55.129:43943)
I20260811 16:51:26.968657 29979 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.55.129:41675
W20260811 16:51:27.058146 30274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:27.058377 30274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:27.058399 30274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:27.059724 30274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:27.059777 30274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:27.059803 30274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:51:27.061247 30274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:42259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:27.061522 30274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:27.061849 30274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:27.067512 30285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:27.067571 30283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:27.067610 30282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:27.067687 30274 server_base.cc:1034] running on GCE node
I20260811 16:51:27.067898 30274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:27.068113 30274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:27.069283 30274 hybrid_clock.cc:648] HybridClock initialized: now 1786467087069265 us; error 31 us; skew 500 ppm
I20260811 16:51:27.070832 30274 webserver.cc:460] Webserver started at http://127.2.55.130:34989/ using document root <none> and password file <none>
I20260811 16:51:27.071188 30274 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:27.071254 30274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:27.071463 30274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:27.072734 30274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "3ce0f61c86b84ac6b3cfb8b6f88b6635"
format_stamp: "Formatted at 2026-08-11 16:51:27 on dist-test-slave-3h5h"
server_key: "78a5ce3dcb33bab96c03881ce66a632d"
server_key_iv: "34e5e547c34a66835fa68848324b2a4b"
server_key_version: "encryptionkey@0"
I20260811 16:51:27.073249 30274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "3ce0f61c86b84ac6b3cfb8b6f88b6635"
format_stamp: "Formatted at 2026-08-11 16:51:27 on dist-test-slave-3h5h"
server_key: "78a5ce3dcb33bab96c03881ce66a632d"
server_key_iv: "34e5e547c34a66835fa68848324b2a4b"
server_key_version: "encryptionkey@0"
I20260811 16:51:27.074821 30274 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:51:27.075759 30292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:27.076053 30274 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:27.076193 30274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "3ce0f61c86b84ac6b3cfb8b6f88b6635"
format_stamp: "Formatted at 2026-08-11 16:51:27 on dist-test-slave-3h5h"
server_key: "78a5ce3dcb33bab96c03881ce66a632d"
server_key_iv: "34e5e547c34a66835fa68848324b2a4b"
server_key_version: "encryptionkey@0"
I20260811 16:51:27.076274 30274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:27.086709 30274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:27.087052 30274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:27.087208 30274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:27.087446 30274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:27.087803 30274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:27.087839 30274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:27.087862 30274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:27.087913 30274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:27.093907 30274 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:38885
I20260811 16:51:27.093973 30469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:38885 every 8 connection(s)
I20260811 16:51:27.094412 30274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:51:27.099610 30033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.095208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:57307 (local address 127.2.55.190:42411)
0811 16:51:27.095278 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:27.095281 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:27.095549 (+ 268us) server_negotiation.cc:407] Connection header received
0811 16:51:27.096027 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:27.096028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:27.096039 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:27.096094 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:27.096760 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.097324 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.098373 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.098553 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.098604 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:27.099388 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:27.099389 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:27.099390 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:27.099394 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:27.099409 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:27.099413 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:27.099460 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:27.099527 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 16:51:27.099549 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:51:27.099815 30475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.095238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:42411 (local address 127.2.55.130:57307)
0811 16:51:27.095423 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:27.095459 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:27.095943 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:27.096149 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:27.096152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:27.096160 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:27.096686 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:27.096691 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.097432 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.097433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:27.098283 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:27.098286 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.098630 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.098631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:27.098739 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:27.099239 (+ 500us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:51:27.099240 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:27.099273 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:51:27.099296 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:27.099464 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:27.099467 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:27.099469 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:51:27.099515 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 16:51:27.099596 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":92,"threads_started":1}
I20260811 16:51:27.100389 30470 heartbeater.cc:347] Connected to a master server at 127.2.55.190:42411
I20260811 16:51:27.100473 30470 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:27.100638 30470 heartbeater.cc:511] Master 127.2.55.190:42411 requested a full tablet report, sending...
I20260811 16:51:27.101008 29979 ts_manager.cc:194] Registered new tserver with Master: 3ce0f61c86b84ac6b3cfb8b6f88b6635 (127.2.55.130:38885)
I20260811 16:51:27.101399 29979 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.55.130:57307
I20260811 16:51:27.104257 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 30274
I20260811 16:51:27.104385 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:51:27.104576 2270 external_mini_cluster.cc:1428] Setting key 528fe417e11990934629a236cc404907
I20260811 16:51:27.105638 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42411
--builtin_ntp_servers=127.2.55.148:42259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:51:27.192106 30479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:27.192332 30479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:27.192355 30479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:27.193490 30479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:27.193526 30479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:27.193552 30479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:51:27.194867 30479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:42259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:42411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:27.195061 30479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:27.195324 30479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:27.200502 30487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:27.200484 30491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:27.200467 30488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:27.200711 30479 server_base.cc:1034] running on GCE node
I20260811 16:51:27.201066 30479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:27.201364 30479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:27.202551 30479 hybrid_clock.cc:648] HybridClock initialized: now 1786467087202541 us; error 40 us; skew 500 ppm
I20260811 16:51:27.203836 30479 webserver.cc:460] Webserver started at http://127.2.55.131:39949/ using document root <none> and password file <none>
I20260811 16:51:27.204171 30479 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:27.204253 30479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:27.204416 30479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:27.205590 30479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "aa4e1c2644794f738dfc8ebaffd779b5"
format_stamp: "Formatted at 2026-08-11 16:51:27 on dist-test-slave-3h5h"
server_key: "a9298aab1fcc30b093308d481792452f"
server_key_iv: "6285831addb6e847de97d33c0d5877ff"
server_key_version: "encryptionkey@0"
I20260811 16:51:27.205955 30479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "aa4e1c2644794f738dfc8ebaffd779b5"
format_stamp: "Formatted at 2026-08-11 16:51:27 on dist-test-slave-3h5h"
server_key: "a9298aab1fcc30b093308d481792452f"
server_key_iv: "6285831addb6e847de97d33c0d5877ff"
server_key_version: "encryptionkey@0"
I20260811 16:51:27.207290 30479 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:51:27.208057 30501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:27.208240 30479 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:51:27.208352 30479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "aa4e1c2644794f738dfc8ebaffd779b5"
format_stamp: "Formatted at 2026-08-11 16:51:27 on dist-test-slave-3h5h"
server_key: "a9298aab1fcc30b093308d481792452f"
server_key_iv: "6285831addb6e847de97d33c0d5877ff"
server_key_version: "encryptionkey@0"
I20260811 16:51:27.208428 30479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:27.231257 30479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:27.231660 30479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:27.231838 30479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:27.232160 30479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:27.232561 30479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:27.232628 30479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:27.232672 30479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:27.232702 30479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:27.239301 30479 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:35269
I20260811 16:51:27.239354 30671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:35269 every 8 connection(s)
I20260811 16:51:27.239718 30479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:51:27.241905 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 30479
I20260811 16:51:27.242027 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:51:27.242226 2270 external_mini_cluster.cc:1428] Setting key 8303a08135e61a9ab91aa7623db86f05
I20260811 16:51:27.245692 30033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.240471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:45703 (local address 127.2.55.190:42411)
0811 16:51:27.240522 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:27.240524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:27.240800 (+ 276us) server_negotiation.cc:407] Connection header received
0811 16:51:27.241389 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:27.241390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:27.241400 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:27.241464 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:27.242317 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.243043 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.244122 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.244346 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.244437 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:27.245364 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:27.245366 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:27.245366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:27.245371 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:27.245389 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:27.245393 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:27.245448 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:27.245578 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 16:51:27.245610 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:51:27.245925 30681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.240425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:42411 (local address 127.2.55.131:45703)
0811 16:51:27.240649 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:27.240694 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:27.241296 (+ 602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:27.241543 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:27.241547 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:27.241556 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:27.242206 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:27.242213 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.243151 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.243152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:27.244012 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:27.244015 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.244446 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.244447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:27.244600 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:27.245173 (+ 573us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:51:27.245173 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:27.245204 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:51:27.245230 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:27.245461 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:27.245466 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:27.245469 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:51:27.245581 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 16:51:27.245689 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":111,"threads_started":1}
I20260811 16:51:27.246448 30672 heartbeater.cc:347] Connected to a master server at 127.2.55.190:42411
I20260811 16:51:27.246573 30672 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:27.246773 30672 heartbeater.cc:511] Master 127.2.55.190:42411 requested a full tablet report, sending...
I20260811 16:51:27.247248 29979 ts_manager.cc:194] Registered new tserver with Master: aa4e1c2644794f738dfc8ebaffd779b5 (127.2.55.131:35269)
I20260811 16:51:27.247669 29979 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.55.131:45703
I20260811 16:51:27.254403 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:51:27.259011 30033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.255848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58684 (local address 127.2.55.190:42411)
0811 16:51:27.255907 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:27.255909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:27.256120 (+ 211us) server_negotiation.cc:407] Connection header received
0811 16:51:27.256166 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:27.256166 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:27.256175 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:27.256242 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:27.256441 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.257001 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.257779 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.257957 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.258009 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:27.258797 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:27.258798 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:27.258799 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:27.258803 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:27.258817 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:27.258821 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:27.258865 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:27.258930 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 16:51:27.258950 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:51:27.260929 29979 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:51:27.262745 29979 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:51:27.269518 30698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.265557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53376 (local address 127.2.55.130:38885)
0811 16:51:27.265736 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:27.265742 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:27.265888 (+ 146us) server_negotiation.cc:407] Connection header received
0811 16:51:27.265935 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:27.265937 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:27.265953 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:27.266055 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:27.266233 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.266966 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.268346 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.269091 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.269170 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:27.269263 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:27.269389 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 16:51:27.269427 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":96,"threads_started":1}
I20260811 16:51:27.269517 30694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.265412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:38885 (local address 127.0.0.1:53376)
0811 16:51:27.265790 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:27.265798 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:27.265846 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:27.266056 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:27.266057 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:27.266059 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:27.266118 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:27.266120 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.267067 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.267068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:27.268254 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:27.268257 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.269192 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.269193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:27.269273 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:27.269290 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 16:51:27.269367 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 16:51:27.269426 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"mutex_wait_us":36,"thread_start_us":102,"threads_started":1}
I20260811 16:51:27.269721 30696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.265140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:43943 (local address 127.0.0.1:47774)
0811 16:51:27.265570 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:27.265615 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:27.265689 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:27.266000 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:27.266003 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:27.266005 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:27.266099 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:27.266101 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.267120 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.267121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:27.268389 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:27.268392 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.269488 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.269489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:27.269547 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:27.269551 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:51:27.269612 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 16:51:27.269653 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"mutex_wait_us":34,"thread_start_us":97,"threads_started":1}
I20260811 16:51:27.269933 30695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.265224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47774 (local address 127.2.55.129:43943)
0811 16:51:27.265425 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:27.265430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:27.265776 (+ 346us) server_negotiation.cc:407] Connection header received
0811 16:51:27.265826 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:27.265829 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:27.265847 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:27.265917 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:27.266186 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.266993 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.268493 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.269294 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.269342 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:27.269428 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:27.269818 (+ 390us) server_negotiation.cc:299] Negotiation successful
0811 16:51:27.269857 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":90,"threads_started":1}
I20260811 16:51:27.270536 30369 tablet_service.cc:1467] Processing CreateTablet for tablet 0ac2ce73d1b248c1afe51aa0ae872d48 (DEFAULT_TABLE table=test-table [id=6947d240c1b04b609b205b05056ad917]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:27.270588 30175 tablet_service.cc:1467] Processing CreateTablet for tablet 0ac2ce73d1b248c1afe51aa0ae872d48 (DEFAULT_TABLE table=test-table [id=6947d240c1b04b609b205b05056ad917]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:27.270869 30369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ac2ce73d1b248c1afe51aa0ae872d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:27.270869 30175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ac2ce73d1b248c1afe51aa0ae872d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:27.273646 30701 tablet_bootstrap.cc:492] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 8f827891ed434980af78a2910b4b2aa5: Bootstrap starting.
I20260811 16:51:27.273752 30699 tablet_bootstrap.cc:492] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635: Bootstrap starting.
I20260811 16:51:27.274355 30699 tablet_bootstrap.cc:654] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:27.274354 30701 tablet_bootstrap.cc:654] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 8f827891ed434980af78a2910b4b2aa5: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:27.274678 30699 log.cc:824] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:27.274729 30701 log.cc:824] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 8f827891ed434980af78a2910b4b2aa5: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:27.275065 30693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.265141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:35269 (local address 127.0.0.1:55652)
0811 16:51:27.265615 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:27.265624 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:27.265689 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:27.267380 (+ 1691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:27.267381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:27.267383 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:27.267422 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:27.267424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.268615 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.268616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:27.269700 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:27.269704 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.274816 (+ 5112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.274818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:27.274898 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:27.274905 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 16:51:27.274942 (+ 37us) client_negotiation.cc:240] Negotiation successful
0811 16:51:27.274991 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"mutex_wait_us":3,"spinlock_wait_cycles":384,"thread_start_us":97,"threads_started":1}
I20260811 16:51:27.275453 30697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.265439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55652 (local address 127.2.55.131:35269)
0811 16:51:27.267208 (+ 1769us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:27.267213 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:27.267223 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:51:27.267262 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:27.267264 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:27.267280 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:27.267360 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:27.267489 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.268530 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.270049 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.274657 (+ 4608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.275215 (+ 558us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:27.275333 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:27.275357 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 16:51:27.275391 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1727,"thread_start_us":79,"threads_started":1}
I20260811 16:51:27.275466 30699 tablet_bootstrap.cc:492] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635: No bootstrap required, opened a new log
I20260811 16:51:27.275548 30699 ts_tablet_manager.cc:1397] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:51:27.276145 30701 tablet_bootstrap.cc:492] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 8f827891ed434980af78a2910b4b2aa5: No bootstrap required, opened a new log
I20260811 16:51:27.276217 30701 ts_tablet_manager.cc:1397] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 8f827891ed434980af78a2910b4b2aa5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 16:51:27.276278 30572 tablet_service.cc:1467] Processing CreateTablet for tablet 0ac2ce73d1b248c1afe51aa0ae872d48 (DEFAULT_TABLE table=test-table [id=6947d240c1b04b609b205b05056ad917]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:27.276669 30572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ac2ce73d1b248c1afe51aa0ae872d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:27.278275 30701 raft_consensus.cc:348] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 8f827891ed434980af78a2910b4b2aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f827891ed434980af78a2910b4b2aa5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43943 } } peers { permanent_uuid: "aa4e1c2644794f738dfc8ebaffd779b5" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35269 } } peers { permanent_uuid: "3ce0f61c86b84ac6b3cfb8b6f88b6635" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 38885 } }
I20260811 16:51:27.278239 30699 raft_consensus.cc:348] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f827891ed434980af78a2910b4b2aa5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43943 } } peers { permanent_uuid: "aa4e1c2644794f738dfc8ebaffd779b5" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35269 } } peers { permanent_uuid: "3ce0f61c86b84ac6b3cfb8b6f88b6635" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 38885 } }
I20260811 16:51:27.278445 30699 raft_consensus.cc:374] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:27.278445 30701 raft_consensus.cc:374] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 8f827891ed434980af78a2910b4b2aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:27.278498 30699 raft_consensus.cc:729] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ce0f61c86b84ac6b3cfb8b6f88b6635, State: Initialized, Role: FOLLOWER
I20260811 16:51:27.278498 30701 raft_consensus.cc:729] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 8f827891ed434980af78a2910b4b2aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f827891ed434980af78a2910b4b2aa5, State: Initialized, Role: FOLLOWER
I20260811 16:51:27.278632 30701 consensus_queue.cc:260] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 8f827891ed434980af78a2910b4b2aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f827891ed434980af78a2910b4b2aa5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43943 } } peers { permanent_uuid: "aa4e1c2644794f738dfc8ebaffd779b5" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35269 } } peers { permanent_uuid: "3ce0f61c86b84ac6b3cfb8b6f88b6635" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 38885 } }
I20260811 16:51:27.278664 30699 consensus_queue.cc:260] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f827891ed434980af78a2910b4b2aa5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43943 } } peers { permanent_uuid: "aa4e1c2644794f738dfc8ebaffd779b5" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35269 } } peers { permanent_uuid: "3ce0f61c86b84ac6b3cfb8b6f88b6635" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 38885 } }
I20260811 16:51:27.278949 30701 ts_tablet_manager.cc:1428] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 8f827891ed434980af78a2910b4b2aa5: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 16:51:27.278988 30269 heartbeater.cc:503] Master 127.2.55.190:42411 was elected leader, sending a full tablet report...
I20260811 16:51:27.279310 30699 ts_tablet_manager.cc:1428] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 16:51:27.279475 30470 heartbeater.cc:503] Master 127.2.55.190:42411 was elected leader, sending a full tablet report...
I20260811 16:51:27.280423 30711 tablet_bootstrap.cc:492] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5: Bootstrap starting.
I20260811 16:51:27.281255 30711 tablet_bootstrap.cc:654] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:27.281574 30711 log.cc:824] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:27.282424 30711 tablet_bootstrap.cc:492] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5: No bootstrap required, opened a new log
I20260811 16:51:27.282481 30711 ts_tablet_manager.cc:1397] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:51:27.284365 30711 raft_consensus.cc:348] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f827891ed434980af78a2910b4b2aa5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43943 } } peers { permanent_uuid: "aa4e1c2644794f738dfc8ebaffd779b5" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35269 } } peers { permanent_uuid: "3ce0f61c86b84ac6b3cfb8b6f88b6635" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 38885 } }
I20260811 16:51:27.284502 30711 raft_consensus.cc:374] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:27.284524 30711 raft_consensus.cc:729] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa4e1c2644794f738dfc8ebaffd779b5, State: Initialized, Role: FOLLOWER
I20260811 16:51:27.284657 30711 consensus_queue.cc:260] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f827891ed434980af78a2910b4b2aa5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43943 } } peers { permanent_uuid: "aa4e1c2644794f738dfc8ebaffd779b5" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35269 } } peers { permanent_uuid: "3ce0f61c86b84ac6b3cfb8b6f88b6635" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 38885 } }
I20260811 16:51:27.284961 30711 ts_tablet_manager.cc:1428] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:51:27.284986 30672 heartbeater.cc:503] Master 127.2.55.190:42411 was elected leader, sending a full tablet report...
W20260811 16:51:27.345257 30474 tablet.cc:2369] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:51:27.349375 30713 raft_consensus.cc:482] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:51:27.349530 30713 raft_consensus.cc:504] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f827891ed434980af78a2910b4b2aa5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43943 } } peers { permanent_uuid: "aa4e1c2644794f738dfc8ebaffd779b5" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35269 } } peers { permanent_uuid: "3ce0f61c86b84ac6b3cfb8b6f88b6635" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 38885 } }
I20260811 16:51:27.349951 30713 leader_election.cc:288] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f827891ed434980af78a2910b4b2aa5 (127.2.55.129:43943), 3ce0f61c86b84ac6b3cfb8b6f88b6635 (127.2.55.130:38885)
I20260811 16:51:27.353538 30681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.350228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:43943 (local address 127.2.55.131:53763)
0811 16:51:27.350309 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:27.350325 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:27.350399 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:27.350701 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:27.350703 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:27.350705 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:27.350790 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:27.350793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.351604 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.351605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:27.352643 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:27.352646 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.353259 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.353260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:27.353336 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:27.353341 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:51:27.353390 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 16:51:27.353423 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":3}
I20260811 16:51:27.353538 30695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.350326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:53763 (local address 127.2.55.129:43943)
0811 16:51:27.350408 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:27.350410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:27.350489 (+ 79us) server_negotiation.cc:407] Connection header received
0811 16:51:27.350527 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:27.350529 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:27.350544 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:27.350618 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:27.350903 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.351523 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.352754 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.353177 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.353236 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:27.353243 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:27.353413 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 16:51:27.353459 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 16:51:27.353609 30698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.350617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:49515 (local address 127.2.55.130:38885)
0811 16:51:27.350667 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:27.350669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:27.350790 (+ 121us) server_negotiation.cc:407] Connection header received
0811 16:51:27.350838 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:27.350839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:27.350852 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:27.350910 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:27.351203 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.351695 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.352719 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.353190 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.353287 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:27.353295 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:27.353490 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 16:51:27.353532 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:51:27.353658 30714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.350524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:38885 (local address 127.2.55.131:49515)
0811 16:51:27.350712 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:27.350721 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:27.350786 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:27.350924 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:27.350925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:27.350928 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:27.351062 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:27.351065 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.351791 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.351792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:27.352621 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:27.352624 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.353306 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.353308 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:27.353394 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:27.353398 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:51:27.353456 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 16:51:27.353491 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":3,"thread_start_us":103,"threads_started":1}
I20260811 16:51:27.353988 30197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ac2ce73d1b248c1afe51aa0ae872d48" candidate_uuid: "aa4e1c2644794f738dfc8ebaffd779b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f827891ed434980af78a2910b4b2aa5" is_pre_election: true
I20260811 16:51:27.353960 30397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ac2ce73d1b248c1afe51aa0ae872d48" candidate_uuid: "aa4e1c2644794f738dfc8ebaffd779b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce0f61c86b84ac6b3cfb8b6f88b6635" is_pre_election: true
I20260811 16:51:27.354142 30197 raft_consensus.cc:2454] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 8f827891ed434980af78a2910b4b2aa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa4e1c2644794f738dfc8ebaffd779b5 in term 0.
I20260811 16:51:27.354142 30397 raft_consensus.cc:2454] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa4e1c2644794f738dfc8ebaffd779b5 in term 0.
I20260811 16:51:27.354391 30502 leader_election.cc:302] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ce0f61c86b84ac6b3cfb8b6f88b6635, aa4e1c2644794f738dfc8ebaffd779b5; no voters:
I20260811 16:51:27.354528 30713 raft_consensus.cc:2781] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:51:27.354586 30713 raft_consensus.cc:482] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:51:27.354617 30713 raft_consensus.cc:3037] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:27.355466 30713 raft_consensus.cc:504] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f827891ed434980af78a2910b4b2aa5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43943 } } peers { permanent_uuid: "aa4e1c2644794f738dfc8ebaffd779b5" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35269 } } peers { permanent_uuid: "3ce0f61c86b84ac6b3cfb8b6f88b6635" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 38885 } }
I20260811 16:51:27.355612 30713 leader_election.cc:288] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [CANDIDATE]: Term 1 election: Requested vote from peers 8f827891ed434980af78a2910b4b2aa5 (127.2.55.129:43943), 3ce0f61c86b84ac6b3cfb8b6f88b6635 (127.2.55.130:38885)
I20260811 16:51:27.355810 30197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ac2ce73d1b248c1afe51aa0ae872d48" candidate_uuid: "aa4e1c2644794f738dfc8ebaffd779b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f827891ed434980af78a2910b4b2aa5"
I20260811 16:51:27.355836 30397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ac2ce73d1b248c1afe51aa0ae872d48" candidate_uuid: "aa4e1c2644794f738dfc8ebaffd779b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ce0f61c86b84ac6b3cfb8b6f88b6635"
I20260811 16:51:27.355894 30197 raft_consensus.cc:3037] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 8f827891ed434980af78a2910b4b2aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:27.355948 30397 raft_consensus.cc:3037] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:27.356753 30197 raft_consensus.cc:2454] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 8f827891ed434980af78a2910b4b2aa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa4e1c2644794f738dfc8ebaffd779b5 in term 1.
I20260811 16:51:27.356895 30397 raft_consensus.cc:2454] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa4e1c2644794f738dfc8ebaffd779b5 in term 1.
I20260811 16:51:27.356940 30502 leader_election.cc:302] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f827891ed434980af78a2910b4b2aa5, aa4e1c2644794f738dfc8ebaffd779b5; no voters:
I20260811 16:51:27.357046 30713 raft_consensus.cc:2781] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:27.357257 30713 raft_consensus.cc:686] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [term 1 LEADER]: Becoming Leader. State: Replica: aa4e1c2644794f738dfc8ebaffd779b5, State: Running, Role: LEADER
I20260811 16:51:27.357379 30713 consensus_queue.cc:237] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f827891ed434980af78a2910b4b2aa5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43943 } } peers { permanent_uuid: "aa4e1c2644794f738dfc8ebaffd779b5" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35269 } } peers { permanent_uuid: "3ce0f61c86b84ac6b3cfb8b6f88b6635" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 38885 } }
I20260811 16:51:27.358337 29978 catalog_manager.cc:5495] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa4e1c2644794f738dfc8ebaffd779b5 (127.2.55.131). New cstate: current_term: 1 leader_uuid: "aa4e1c2644794f738dfc8ebaffd779b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f827891ed434980af78a2910b4b2aa5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa4e1c2644794f738dfc8ebaffd779b5" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ce0f61c86b84ac6b3cfb8b6f88b6635" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 38885 } health_report { overall_health: UNKNOWN } } }
I20260811 16:51:27.386505 30697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.383876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55654 (local address 127.2.55.131:35269)
0811 16:51:27.383949 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:27.383951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:27.383961 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:51:27.384009 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:27.384010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:27.384038 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:27.384135 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:51:27.384293 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.384785 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.385629 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:27.385847 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:27.385926 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:27.386117 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:51:27.386230 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:51:27.386333 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:27.386357 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 16:51:27.386375 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:51:27.388571 30397 raft_consensus.cc:1261] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635 [term 1 FOLLOWER]: Refusing update from remote peer aa4e1c2644794f738dfc8ebaffd779b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:51:27.388584 30197 raft_consensus.cc:1261] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 8f827891ed434980af78a2910b4b2aa5 [term 1 FOLLOWER]: Refusing update from remote peer aa4e1c2644794f738dfc8ebaffd779b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:51:27.389046 30713 consensus_queue.cc:1035] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ce0f61c86b84ac6b3cfb8b6f88b6635" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 38885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:51:27.389237 30716 consensus_queue.cc:1035] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f827891ed434980af78a2910b4b2aa5" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 43943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:51:27.391829 30723 mvcc.cc:205] Tried to move back new op lower bound from 7317369189940494336 to 7317369189816713216. Current Snapshot: MvccSnapshot[applied={T|T < 7317369189940494336}]
I20260811 16:51:27.393961 30722 mvcc.cc:205] Tried to move back new op lower bound from 7317369189940494336 to 7317369189816713216. Current Snapshot: MvccSnapshot[applied={T|T < 7317369189940494336}]
I20260811 16:51:27.394192 29979 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:51:27.394315 29979 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:51:27.395203 29979 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 12faa3d5fb8748c3b21fe6c35a4bdc4f: Sending DeleteTablet for 3 replicas of tablet 0ac2ce73d1b248c1afe51aa0ae872d48
I20260811 16:51:27.395571 30369 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ac2ce73d1b248c1afe51aa0ae872d48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:27 UTC) from {username='slave'} at 127.0.0.1:53376
I20260811 16:51:27.395584 30572 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ac2ce73d1b248c1afe51aa0ae872d48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:27 UTC) from {username='slave'} at 127.0.0.1:55652
I20260811 16:51:27.395798 30732 tablet_replica.cc:330] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635: stopping tablet replica
I20260811 16:51:27.395887 30732 raft_consensus.cc:2229] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:51:27.395987 30732 raft_consensus.cc:2258] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:51:27.395965 30175 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ac2ce73d1b248c1afe51aa0ae872d48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:27 UTC) from {username='slave'} at 127.0.0.1:47774
I20260811 16:51:27.396080 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 30068
I20260811 16:51:27.403548 30732 ts_tablet_manager.cc:1905] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:51:27.396155 30733 tablet_replica.cc:330] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5: stopping tablet replica
I20260811 16:51:27.405555 30733 raft_consensus.cc:2229] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:51:27.405670 30732 ts_tablet_manager.cc:1918] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:51:27.405722 30733 raft_consensus.cc:2258] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:51:27.405754 30732 log.cc:1196] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/0ac2ce73d1b248c1afe51aa0ae872d48
I20260811 16:51:27.406044 30732 ts_tablet_manager.cc:1939] T 0ac2ce73d1b248c1afe51aa0ae872d48 P 3ce0f61c86b84ac6b3cfb8b6f88b6635: Deleting consensus metadata
I20260811 16:51:27.407604 30733 ts_tablet_manager.cc:1905] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:51:27.407742 29953 catalog_manager.cc:4841] TS 3ce0f61c86b84ac6b3cfb8b6f88b6635 (127.2.55.130:38885): tablet 0ac2ce73d1b248c1afe51aa0ae872d48 (table test-table [id=6947d240c1b04b609b205b05056ad917]) successfully deleted
I20260811 16:51:27.409757 30733 ts_tablet_manager.cc:1918] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:51:27.409865 30733 log.cc:1196] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/0ac2ce73d1b248c1afe51aa0ae872d48
I20260811 16:51:27.410334 30733 ts_tablet_manager.cc:1939] T 0ac2ce73d1b248c1afe51aa0ae872d48 P aa4e1c2644794f738dfc8ebaffd779b5: Deleting consensus metadata
I20260811 16:51:27.410858 29960 catalog_manager.cc:4841] TS aa4e1c2644794f738dfc8ebaffd779b5 (127.2.55.131:35269): tablet 0ac2ce73d1b248c1afe51aa0ae872d48 (table test-table [id=6947d240c1b04b609b205b05056ad917]) successfully deleted
W20260811 16:51:27.415166 29953 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.55.129:43943 (error 108)
I20260811 16:51:27.415422 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 30274
I20260811 16:51:27.425797 30693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:27.415569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:43943 (local address 127.0.0.1:47784)
0811 16:51:27.425642 (+ 10073us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:27.425741 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:43943: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10038}
W20260811 16:51:27.427762 29953 catalog_manager.cc:4584] TS 8f827891ed434980af78a2910b4b2aa5 (127.2.55.129:43943): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0ac2ce73d1b248c1afe51aa0ae872d48: Network error: Client connection negotiation failed: client connection to 127.2.55.129:43943: connect: Connection refused (error 111)
I20260811 16:51:27.432611 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 30479
I20260811 16:51:27.443615 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 29931
2026-08-11T16:51:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (842 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:27 dist-test-slave-3h5h krb5kdc[30740](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:27 dist-test-slave-3h5h krb5kdc[30740](info): set up 2 sockets
Aug 11 16:51:27 dist-test-slave-3h5h krb5kdc[30740](info): commencing operation
krb5kdc: starting...
W20260811 16:51:28.768685 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:28 dist-test-slave-3h5h krb5kdc[30740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:51:28.903688 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:41289
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:37629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:41289
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:28.988596 30770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:28.988893 30770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:28.988947 30770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:28.990160 30770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:28.990235 30770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:28.990260 30770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:28.990289 30770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:28.990320 30770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:28.991894 30770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:37629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:41289
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:41289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:28.992204 30770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:28.992467 30770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:28.997611 30783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:28.997611 30781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:28.997676 30778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:28.997718 30770 server_base.cc:1034] running on GCE node
I20260811 16:51:28.998075 30770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:28.998338 30770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:28.999482 30770 hybrid_clock.cc:648] HybridClock initialized: now 1786467088999460 us; error 39 us; skew 500 ppm
Aug 11 16:51:29 dist-test-slave-3h5h krb5kdc[30740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467089, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:29.005637 30770 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:51:29.006129 30770 webserver.cc:460] Webserver started at http://127.2.55.190:40893/ using document root <none> and password file <none>
I20260811 16:51:29.006337 30770 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:29.006378 30770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:29.006472 30770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:29.007647 30770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "10d4a0ce49044a2f883eb77c36dcbf48"
format_stamp: "Formatted at 2026-08-11 16:51:29 on dist-test-slave-3h5h"
server_key: "a490e3033cd0cb9232d4c93129a72e78"
server_key_iv: "3bf8c50720c290cd2d2a96d39ca16ecc"
server_key_version: "encryptionkey@0"
I20260811 16:51:29.007965 30770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "10d4a0ce49044a2f883eb77c36dcbf48"
format_stamp: "Formatted at 2026-08-11 16:51:29 on dist-test-slave-3h5h"
server_key: "a490e3033cd0cb9232d4c93129a72e78"
server_key_iv: "3bf8c50720c290cd2d2a96d39ca16ecc"
server_key_version: "encryptionkey@0"
I20260811 16:51:29.009397 30770 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:51:29.010152 30796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:29.010375 30770 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:29.010455 30770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "10d4a0ce49044a2f883eb77c36dcbf48"
format_stamp: "Formatted at 2026-08-11 16:51:29 on dist-test-slave-3h5h"
server_key: "a490e3033cd0cb9232d4c93129a72e78"
server_key_iv: "3bf8c50720c290cd2d2a96d39ca16ecc"
server_key_version: "encryptionkey@0"
I20260811 16:51:29.010521 30770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:29.018399 30770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:29.020572 30770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:29.020696 30770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:29.025396 30770 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:41289
I20260811 16:51:29.025453 30871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:41289 every 8 connection(s)
I20260811 16:51:29.025827 30770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:29.026772 30874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:29.029161 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 30770
I20260811 16:51:29.029258 30874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48: Bootstrap starting.
I20260811 16:51:29.029302 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:29.029507 2270 external_mini_cluster.cc:1428] Setting key 8ebac92916fae1b818fee31b038d0452
I20260811 16:51:29.030064 30874 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:29.030411 30874 log.cc:824] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:29.031199 30874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48: No bootstrap required, opened a new log
I20260811 16:51:29.033627 30874 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d4a0ce49044a2f883eb77c36dcbf48" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41289 } }
I20260811 16:51:29.033808 30874 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:29.033834 30874 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d4a0ce49044a2f883eb77c36dcbf48, State: Initialized, Role: FOLLOWER
I20260811 16:51:29.033977 30874 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d4a0ce49044a2f883eb77c36dcbf48" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41289 } }
I20260811 16:51:29.034052 30874 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:29.034075 30874 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:29.034129 30874 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:29.034839 30874 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d4a0ce49044a2f883eb77c36dcbf48" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41289 } }
I20260811 16:51:29.034946 30874 leader_election.cc:302] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10d4a0ce49044a2f883eb77c36dcbf48; no voters:
I20260811 16:51:29.035105 30874 leader_election.cc:288] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:29.035224 30881 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:29.035377 30874 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:29.035466 30881 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [term 1 LEADER]: Becoming Leader. State: Replica: 10d4a0ce49044a2f883eb77c36dcbf48, State: Running, Role: LEADER
I20260811 16:51:29.035566 30881 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d4a0ce49044a2f883eb77c36dcbf48" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41289 } }
I20260811 16:51:29.035921 30882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10d4a0ce49044a2f883eb77c36dcbf48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d4a0ce49044a2f883eb77c36dcbf48" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41289 } } }
I20260811 16:51:29.036018 30882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:29.036304 30883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10d4a0ce49044a2f883eb77c36dcbf48. Latest consensus state: current_term: 1 leader_uuid: "10d4a0ce49044a2f883eb77c36dcbf48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d4a0ce49044a2f883eb77c36dcbf48" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 41289 } } }
I20260811 16:51:29.036445 30883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:29.036710 30894 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:29.037432 30894 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 16:51:29 dist-test-slave-3h5h krb5kdc[30740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:51:29.039129 30894 catalog_manager.cc:1347] Generated new cluster ID: b405d64f31f24e3a90615056a2b9784a
I20260811 16:51:29.039194 30894 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:29.042484 30877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.030084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47134 (local address 127.2.55.190:41289)
0811 16:51:29.030287 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:29.030298 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:29.030393 (+ 95us) server_negotiation.cc:407] Connection header received
0811 16:51:29.031047 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:29.031057 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:29.031118 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:29.031287 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:29.031994 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.033533 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.034574 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.035241 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.037157 (+ 1916us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.038474 (+ 1317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:29.038479 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:29.038479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:29.038493 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:29.040719 (+ 2226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:29.041150 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:29.041154 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:29.041155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:29.041280 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:29.041505 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:29.041506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:29.041506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:29.041846 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:29.042028 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:29.042111 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 16:51:29.042252 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":87,"threads_started":1}
I20260811 16:51:29.049876 30894 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:29.050917 30894 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:29.054708 30894 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48: Generated new TSK 0
I20260811 16:51:29.054929 30894 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:51:29.091522 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41289
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:37629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:29.177708 30913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:29.177938 30913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:29.177980 30913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:29.179160 30913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:29.179239 30913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:29.179286 30913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:51:29.180790 30913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:37629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:29.181038 30913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:29.181237 30913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:29.186522 30921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:29.186517 30924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:29.186517 30922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:29.186754 30913 server_base.cc:1034] running on GCE node
I20260811 16:51:29.186951 30913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:29.187207 30913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:29.188364 30913 hybrid_clock.cc:648] HybridClock initialized: now 1786467089188346 us; error 37 us; skew 500 ppm
Aug 11 16:51:29 dist-test-slave-3h5h krb5kdc[30740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467089, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:29.191046 30913 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:51:29.191505 30913 webserver.cc:460] Webserver started at http://127.2.55.129:37899/ using document root <none> and password file <none>
I20260811 16:51:29.191725 30913 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:29.191766 30913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:29.191859 30913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:29.192963 30913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "2bb5f5bca6484b939f856bc56f1d1cde"
format_stamp: "Formatted at 2026-08-11 16:51:29 on dist-test-slave-3h5h"
server_key: "986943dded7aef98ced02a189b101cad"
server_key_iv: "ad7f737e0fc235011715d13801ddbb41"
server_key_version: "encryptionkey@0"
I20260811 16:51:29.193316 30913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "2bb5f5bca6484b939f856bc56f1d1cde"
format_stamp: "Formatted at 2026-08-11 16:51:29 on dist-test-slave-3h5h"
server_key: "986943dded7aef98ced02a189b101cad"
server_key_iv: "ad7f737e0fc235011715d13801ddbb41"
server_key_version: "encryptionkey@0"
I20260811 16:51:29.194717 30913 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:51:29.195447 30936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:29.195673 30913 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:51:29.195742 30913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "2bb5f5bca6484b939f856bc56f1d1cde"
format_stamp: "Formatted at 2026-08-11 16:51:29 on dist-test-slave-3h5h"
server_key: "986943dded7aef98ced02a189b101cad"
server_key_iv: "ad7f737e0fc235011715d13801ddbb41"
server_key_version: "encryptionkey@0"
I20260811 16:51:29.195796 30913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:29.218657 30913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:29.221127 30913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:29.221256 30913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:29.221470 30913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:29.221820 30913 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:29.221859 30913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:29.221884 30913 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:29.221895 30913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:29.228037 30913 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:39369
I20260811 16:51:29.228075 31116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:39369 every 8 connection(s)
I20260811 16:51:29.228473 30913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:51:29 dist-test-slave-3h5h krb5kdc[30740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467089, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:51:29.238339 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 30913
I20260811 16:51:29.238457 30877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.229315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:52827 (local address 127.2.55.190:41289)
0811 16:51:29.229402 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:29.229404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:29.229573 (+ 169us) server_negotiation.cc:407] Connection header received
0811 16:51:29.230169 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:29.230170 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:29.230181 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:29.230250 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:29.231228 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.231743 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.232697 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.232916 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.232990 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.235480 (+ 2490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:29.235482 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:29.235483 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:29.235491 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:29.236960 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:29.237371 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:29.237373 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:29.237374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:29.237438 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:29.237721 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:29.237722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:29.237722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:29.237844 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:29.237920 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:29.238266 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 16:51:29.238349 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 16:51:29.238476 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:51:29.238736 2270 external_mini_cluster.cc:1428] Setting key b24369f7c750c5b2e4fa0032b13a3687
I20260811 16:51:29.238776 31129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.229233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:41289 (local address 127.2.55.129:52827)
0811 16:51:29.229426 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:29.229471 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:29.229990 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:29.230331 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:29.230334 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:29.230934 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:29.231128 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:29.231133 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.231825 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.231826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:29.232612 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:29.232614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.233003 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.233004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:29.233109 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.233607 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:51:29.233616 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:29.235318 (+ 1702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:29.237042 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:29.237052 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:29.237054 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:29.237290 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:29.237516 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:29.237517 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:29.237518 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:29.237634 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:29.237922 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:29.237931 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:29.238072 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 16:51:29.238220 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 16:51:29.238414 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":98,"threads_started":1}
I20260811 16:51:29.239449 31117 heartbeater.cc:347] Connected to a master server at 127.2.55.190:41289
I20260811 16:51:29.239573 31117 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:29.239814 31117 heartbeater.cc:511] Master 127.2.55.190:41289 requested a full tablet report, sending...
I20260811 16:51:29.240648 30817 ts_manager.cc:194] Registered new tserver with Master: 2bb5f5bca6484b939f856bc56f1d1cde (127.2.55.129:39369)
I20260811 16:51:29.241380 30817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:52827
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:51:29.269168 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41289
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:37629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:29.357642 31135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:29.357884 31135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:29.357924 31135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:29.359083 31135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:29.359153 31135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:29.359200 31135 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:51:29.360687 31135 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:37629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31135
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:29.360982 31135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:29.361236 31135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:29.366782 31146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:29.366801 31142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:29.366990 31135 server_base.cc:1034] running on GCE node
W20260811 16:51:29.366801 31143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:29.367336 31135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:29.367606 31135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:29.368785 31135 hybrid_clock.cc:648] HybridClock initialized: now 1786467089368779 us; error 38 us; skew 500 ppm
Aug 11 16:51:29 dist-test-slave-3h5h krb5kdc[30740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467089, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:29.371475 31135 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:51:29.371989 31135 webserver.cc:460] Webserver started at http://127.2.55.130:41091/ using document root <none> and password file <none>
I20260811 16:51:29.372229 31135 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:29.372298 31135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:29.372458 31135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:29.373632 31135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "f83b92ca91c444cfaab4ca3d449c5ee0"
format_stamp: "Formatted at 2026-08-11 16:51:29 on dist-test-slave-3h5h"
server_key: "32c26adbfc8b41b8ee860f73bee4d439"
server_key_iv: "4c977ae23aab9b4070d2653530403913"
server_key_version: "encryptionkey@0"
I20260811 16:51:29.374027 31135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "f83b92ca91c444cfaab4ca3d449c5ee0"
format_stamp: "Formatted at 2026-08-11 16:51:29 on dist-test-slave-3h5h"
server_key: "32c26adbfc8b41b8ee860f73bee4d439"
server_key_iv: "4c977ae23aab9b4070d2653530403913"
server_key_version: "encryptionkey@0"
I20260811 16:51:29.375432 31135 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:51:29.376233 31156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:29.376418 31135 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:51:29.376526 31135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "f83b92ca91c444cfaab4ca3d449c5ee0"
format_stamp: "Formatted at 2026-08-11 16:51:29 on dist-test-slave-3h5h"
server_key: "32c26adbfc8b41b8ee860f73bee4d439"
server_key_iv: "4c977ae23aab9b4070d2653530403913"
server_key_version: "encryptionkey@0"
I20260811 16:51:29.376606 31135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:29.386875 31135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:29.388787 31135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:29.388983 31135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:29.389235 31135 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:29.389582 31135 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:29.389648 31135 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:29.389699 31135 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:29.389729 31135 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:29.396178 31135 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:34569
I20260811 16:51:29.396238 31336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:34569 every 8 connection(s)
I20260811 16:51:29.396545 31135 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:51:29 dist-test-slave-3h5h krb5kdc[30740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467089, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:51:29.405671 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 31135
I20260811 16:51:29.405810 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:51:29.406024 2270 external_mini_cluster.cc:1428] Setting key 18e840f1d6a16b92c4ac255994cefe13
I20260811 16:51:29.406322 30877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.397324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:48307 (local address 127.2.55.190:41289)
0811 16:51:29.397386 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:29.397388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:29.397606 (+ 218us) server_negotiation.cc:407] Connection header received
0811 16:51:29.398170 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:29.398172 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:29.398186 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:29.398256 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:29.399337 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.399933 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.400980 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.401184 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.401272 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.403376 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:29.403379 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:29.403379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:29.403388 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:29.404567 (+ 1179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:29.405120 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:29.405121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:29.405121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:29.405178 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:29.405576 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:29.405578 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:29.405578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:29.405701 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:29.405779 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:29.406137 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 16:51:29.406230 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:51:29.406500 31342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.397291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:41289 (local address 127.2.55.130:48307)
0811 16:51:29.397483 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:29.397526 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:29.398041 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:29.398328 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:29.398332 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:29.398998 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:29.399189 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:29.399195 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.400032 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.400033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:29.400890 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:29.400895 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.401285 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.401286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:29.401411 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.401904 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:51:29.401913 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:29.403275 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:29.404671 (+ 1396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:29.404679 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:29.404681 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:29.404984 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:29.405354 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:29.405355 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:29.405355 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:29.405491 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:29.405780 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:29.405789 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:29.405971 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 16:51:29.406095 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 16:51:29.406256 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":88,"threads_started":1}
I20260811 16:51:29.407044 31337 heartbeater.cc:347] Connected to a master server at 127.2.55.190:41289
I20260811 16:51:29.407130 31337 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:29.407342 31337 heartbeater.cc:511] Master 127.2.55.190:41289 requested a full tablet report, sending...
I20260811 16:51:29.407855 30817 ts_manager.cc:194] Registered new tserver with Master: f83b92ca91c444cfaab4ca3d449c5ee0 (127.2.55.130:34569)
I20260811 16:51:29.408239 30817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:48307
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:51:29.436198 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41289
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:37629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:29.519815 31345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:29.520025 31345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:29.520048 31345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:29.521226 31345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:29.521268 31345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:29.521338 31345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:51:29.522830 31345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:37629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:41289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:29.523073 31345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:29.523309 31345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:29.528383 31352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:29.528452 31345 server_base.cc:1034] running on GCE node
W20260811 16:51:29.528393 31354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:29.528399 31351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:29.528878 31345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:29.529170 31345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:29.530344 31345 hybrid_clock.cc:648] HybridClock initialized: now 1786467089530332 us; error 43 us; skew 500 ppm
Aug 11 16:51:29 dist-test-slave-3h5h krb5kdc[30740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467089, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:29.533021 31345 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:51:29.533463 31345 webserver.cc:460] Webserver started at http://127.2.55.131:46313/ using document root <none> and password file <none>
I20260811 16:51:29.533653 31345 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:29.533694 31345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:29.533797 31345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:29.534907 31345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "b53b323e27e74b2ebf9ae02d168f2d8b"
format_stamp: "Formatted at 2026-08-11 16:51:29 on dist-test-slave-3h5h"
server_key: "5eb0502fbf380173edec1f0c9f405c95"
server_key_iv: "4771d2eef3a2791f1f779fcae65afc77"
server_key_version: "encryptionkey@0"
I20260811 16:51:29.535282 31345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "b53b323e27e74b2ebf9ae02d168f2d8b"
format_stamp: "Formatted at 2026-08-11 16:51:29 on dist-test-slave-3h5h"
server_key: "5eb0502fbf380173edec1f0c9f405c95"
server_key_iv: "4771d2eef3a2791f1f779fcae65afc77"
server_key_version: "encryptionkey@0"
I20260811 16:51:29.536804 31345 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:51:29.537731 31365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:29.537919 31345 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:29.538062 31345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "b53b323e27e74b2ebf9ae02d168f2d8b"
format_stamp: "Formatted at 2026-08-11 16:51:29 on dist-test-slave-3h5h"
server_key: "5eb0502fbf380173edec1f0c9f405c95"
server_key_iv: "4771d2eef3a2791f1f779fcae65afc77"
server_key_version: "encryptionkey@0"
I20260811 16:51:29.538136 31345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:29.554396 31345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:29.556905 31345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:29.557082 31345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:29.557325 31345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:29.557648 31345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:29.557703 31345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:29.557739 31345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:29.557766 31345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:29.564106 31345 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:41771
I20260811 16:51:29.564158 31543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:41771 every 8 connection(s)
I20260811 16:51:29.564502 31345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:51:29 dist-test-slave-3h5h krb5kdc[30740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467089, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:51:29.571802 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 31345
I20260811 16:51:29.571905 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:51:29.572096 2270 external_mini_cluster.cc:1428] Setting key 749a7a0595122b59c7c63526b56a76bf
I20260811 16:51:29.574126 30877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.565288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:58769 (local address 127.2.55.190:41289)
0811 16:51:29.565359 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:29.565361 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:29.565573 (+ 212us) server_negotiation.cc:407] Connection header received
0811 16:51:29.566095 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:29.566096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:29.566107 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:29.566159 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:29.567099 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.567601 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.568555 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.568749 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.568808 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.571042 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:29.571044 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:29.571044 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:29.571052 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:29.572625 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:29.573129 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:29.573130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:29.573130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:29.573194 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:29.573459 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:29.573460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:29.573460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:29.573587 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:29.573663 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:29.573952 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 16:51:29.574032 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:51:29.574331 31546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.565260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:41289 (local address 127.2.55.131:58769)
0811 16:51:29.565466 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:29.565504 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:29.565994 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:29.566222 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:29.566225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:29.566821 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:29.567017 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:29.567022 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.567693 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.567693 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:29.568472 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:29.568473 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.568828 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.568868 (+ 40us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:29.568996 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.569472 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:51:29.569480 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:29.570932 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:29.572724 (+ 1792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:29.572731 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:29.572734 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:29.573041 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:29.573270 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:29.573270 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:29.573271 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:29.573384 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:29.573654 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:29.573661 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:29.573812 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 16:51:29.573917 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 16:51:29.574090 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":117,"threads_started":1}
I20260811 16:51:29.574829 31544 heartbeater.cc:347] Connected to a master server at 127.2.55.190:41289
I20260811 16:51:29.574930 31544 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:29.575078 31544 heartbeater.cc:511] Master 127.2.55.190:41289 requested a full tablet report, sending...
I20260811 16:51:29.575466 30817 ts_manager.cc:194] Registered new tserver with Master: b53b323e27e74b2ebf9ae02d168f2d8b (127.2.55.131:41771)
I20260811 16:51:29.575853 30817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:58769
I20260811 16:51:29.583877 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:51:29.591794 30877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.585393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47146 (local address 127.2.55.190:41289)
0811 16:51:29.585471 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:29.585473 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:29.585491 (+ 18us) server_negotiation.cc:407] Connection header received
0811 16:51:29.585512 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:29.585512 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:29.585522 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:29.585589 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:29.586146 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.586696 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.587429 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.587637 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.587699 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.589019 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:29.589021 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:29.589021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:29.589028 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:29.590619 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:29.590989 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:29.590990 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:29.590991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:29.591102 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:29.591329 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:29.591330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:29.591330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:29.591479 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:29.591570 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:29.591663 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 16:51:29.591719 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 16:51:29.593844 30817 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47146:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:51:29.595674 30817 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:51:29.602945 31564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.598530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34416 (local address 127.2.55.129:39369)
0811 16:51:29.599055 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:29.599058 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:29.599067 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:51:29.599305 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:29.599308 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:29.599326 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:29.599531 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:29.599603 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.600659 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.601863 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.602461 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.602586 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.602657 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:29.602806 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 16:51:29.602857 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":84,"threads_started":1}
I20260811 16:51:29.602937 31563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.598352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:39369 (local address 127.0.0.1:34416)
0811 16:51:29.598807 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:29.598817 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:29.598866 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:29.599422 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:29.599423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:29.599426 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:29.599463 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:29.599464 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.600771 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.600772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:29.601782 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:29.601786 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.602587 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.602588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:29.602672 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.602688 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 16:51:29.602770 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 16:51:29.602832 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"mutex_wait_us":1,"thread_start_us":127,"threads_started":1}
I20260811 16:51:29.603027 31567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.598591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53682 (local address 127.2.55.130:34569)
0811 16:51:29.598774 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:29.598779 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:29.598792 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:51:29.599003 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:29.599005 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:29.599022 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:29.599308 (+ 286us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:29.599393 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.600536 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.601951 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.602625 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.602738 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.602820 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:29.602904 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 16:51:29.602942 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":98,"threads_started":1}
I20260811 16:51:29.603451 31557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.598325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:41771 (local address 127.0.0.1:57788)
0811 16:51:29.598784 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:29.598795 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:29.598863 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:29.599065 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:29.599068 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:29.599071 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:29.599158 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:29.599160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.600257 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.600258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:29.601714 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:29.601717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.603184 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.603185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:29.603259 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.603263 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:51:29.603327 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:51:29.603367 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":204,"threads_started":1}
I20260811 16:51:29.603623 31566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.598541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57788 (local address 127.2.55.131:41771)
0811 16:51:29.598770 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:29.598776 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:29.598848 (+ 72us) server_negotiation.cc:407] Connection header received
0811 16:51:29.598938 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:29.598940 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:29.598957 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:29.599118 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:29.599222 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.600147 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.601810 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.602525 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.602603 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.602663 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:29.603352 (+ 689us) server_negotiation.cc:299] Negotiation successful
0811 16:51:29.603390 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":104,"threads_started":1}
I20260811 16:51:29.603987 31559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.598321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:34569 (local address 127.0.0.1:53682)
0811 16:51:29.598595 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:29.598638 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:29.598708 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:29.599145 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:29.599146 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:29.599148 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:29.599202 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:29.599203 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.600647 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.600648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:29.601884 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:29.601886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.602751 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.602752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:29.602823 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.602826 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:51:29.602893 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 16:51:29.602925 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"mutex_wait_us":1,"thread_start_us":54,"threads_started":1}
I20260811 16:51:29.603974 31021 tablet_service.cc:1467] Processing CreateTablet for tablet 405ef090361447539b99a6cbeac52ff2 (DEFAULT_TABLE table=test-table [id=2e3107033ec34c8d8571a9601095de2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:29.604414 31021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 405ef090361447539b99a6cbeac52ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:29.604776 31223 tablet_service.cc:1467] Processing CreateTablet for tablet 405ef090361447539b99a6cbeac52ff2 (DEFAULT_TABLE table=test-table [id=2e3107033ec34c8d8571a9601095de2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:29.605190 31223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 405ef090361447539b99a6cbeac52ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:29.608151 31568 tablet_bootstrap.cc:492] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde: Bootstrap starting.
I20260811 16:51:29.608664 31569 tablet_bootstrap.cc:492] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0: Bootstrap starting.
I20260811 16:51:29.608630 31444 tablet_service.cc:1467] Processing CreateTablet for tablet 405ef090361447539b99a6cbeac52ff2 (DEFAULT_TABLE table=test-table [id=2e3107033ec34c8d8571a9601095de2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:29.608882 31568 tablet_bootstrap.cc:654] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:29.609011 31444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 405ef090361447539b99a6cbeac52ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:29.609566 31568 log.cc:824] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:29.609715 31569 tablet_bootstrap.cc:654] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:29.610412 31569 log.cc:824] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:29.610546 31568 tablet_bootstrap.cc:492] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde: No bootstrap required, opened a new log
I20260811 16:51:29.610617 31568 ts_tablet_manager.cc:1397] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 16:51:29.611369 31569 tablet_bootstrap.cc:492] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0: No bootstrap required, opened a new log
I20260811 16:51:29.611526 31569 ts_tablet_manager.cc:1397] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:51:29.611779 31574 tablet_bootstrap.cc:492] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b: Bootstrap starting.
I20260811 16:51:29.612377 31574 tablet_bootstrap.cc:654] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:29.612699 31568 raft_consensus.cc:348] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53b323e27e74b2ebf9ae02d168f2d8b" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41771 } } peers { permanent_uuid: "f83b92ca91c444cfaab4ca3d449c5ee0" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34569 } } peers { permanent_uuid: "2bb5f5bca6484b939f856bc56f1d1cde" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39369 } }
I20260811 16:51:29.612924 31568 raft_consensus.cc:374] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:29.612973 31568 raft_consensus.cc:729] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb5f5bca6484b939f856bc56f1d1cde, State: Initialized, Role: FOLLOWER
I20260811 16:51:29.613008 31574 log.cc:824] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:29.613112 31568 consensus_queue.cc:260] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53b323e27e74b2ebf9ae02d168f2d8b" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41771 } } peers { permanent_uuid: "f83b92ca91c444cfaab4ca3d449c5ee0" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34569 } } peers { permanent_uuid: "2bb5f5bca6484b939f856bc56f1d1cde" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39369 } }
I20260811 16:51:29.613410 31568 ts_tablet_manager.cc:1428] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 16:51:29.613466 31117 heartbeater.cc:503] Master 127.2.55.190:41289 was elected leader, sending a full tablet report...
I20260811 16:51:29.613987 31574 tablet_bootstrap.cc:492] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b: No bootstrap required, opened a new log
I20260811 16:51:29.614056 31574 ts_tablet_manager.cc:1397] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:51:29.614041 31569 raft_consensus.cc:348] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53b323e27e74b2ebf9ae02d168f2d8b" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41771 } } peers { permanent_uuid: "f83b92ca91c444cfaab4ca3d449c5ee0" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34569 } } peers { permanent_uuid: "2bb5f5bca6484b939f856bc56f1d1cde" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39369 } }
I20260811 16:51:29.614215 31569 raft_consensus.cc:374] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:29.614260 31569 raft_consensus.cc:729] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f83b92ca91c444cfaab4ca3d449c5ee0, State: Initialized, Role: FOLLOWER
I20260811 16:51:29.614416 31569 consensus_queue.cc:260] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53b323e27e74b2ebf9ae02d168f2d8b" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41771 } } peers { permanent_uuid: "f83b92ca91c444cfaab4ca3d449c5ee0" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34569 } } peers { permanent_uuid: "2bb5f5bca6484b939f856bc56f1d1cde" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39369 } }
I20260811 16:51:29.614707 31337 heartbeater.cc:503] Master 127.2.55.190:41289 was elected leader, sending a full tablet report...
I20260811 16:51:29.614710 31569 ts_tablet_manager.cc:1428] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:51:29.615983 31574 raft_consensus.cc:348] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53b323e27e74b2ebf9ae02d168f2d8b" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41771 } } peers { permanent_uuid: "f83b92ca91c444cfaab4ca3d449c5ee0" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34569 } } peers { permanent_uuid: "2bb5f5bca6484b939f856bc56f1d1cde" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39369 } }
I20260811 16:51:29.616125 31574 raft_consensus.cc:374] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:29.616171 31574 raft_consensus.cc:729] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b53b323e27e74b2ebf9ae02d168f2d8b, State: Initialized, Role: FOLLOWER
I20260811 16:51:29.616292 31574 consensus_queue.cc:260] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53b323e27e74b2ebf9ae02d168f2d8b" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41771 } } peers { permanent_uuid: "f83b92ca91c444cfaab4ca3d449c5ee0" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34569 } } peers { permanent_uuid: "2bb5f5bca6484b939f856bc56f1d1cde" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39369 } }
I20260811 16:51:29.616530 31574 ts_tablet_manager.cc:1428] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:51:29.616614 31544 heartbeater.cc:503] Master 127.2.55.190:41289 was elected leader, sending a full tablet report...
W20260811 16:51:29.647128 31339 tablet.cc:2369] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:51:29.682053 31585 raft_consensus.cc:482] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:51:29.682401 31585 raft_consensus.cc:504] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53b323e27e74b2ebf9ae02d168f2d8b" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41771 } } peers { permanent_uuid: "f83b92ca91c444cfaab4ca3d449c5ee0" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34569 } } peers { permanent_uuid: "2bb5f5bca6484b939f856bc56f1d1cde" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39369 } }
I20260811 16:51:29.682893 31585 leader_election.cc:288] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f83b92ca91c444cfaab4ca3d449c5ee0 (127.2.55.130:34569), 2bb5f5bca6484b939f856bc56f1d1cde (127.2.55.129:39369)
I20260811 16:51:29.687328 31587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.683100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:34569 (local address 127.2.55.131:53841)
0811 16:51:29.683327 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:29.683335 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:29.683378 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:29.683537 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:29.683538 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:29.683539 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:29.683668 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:29.683670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.684719 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.684720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:29.686133 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:29.686136 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.687008 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.687009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:29.687068 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.687072 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:51:29.687143 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 16:51:29.687212 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":129,"thread_start_us":139,"threads_started":1}
I20260811 16:51:29.687343 31567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.683217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:53841 (local address 127.2.55.130:34569)
0811 16:51:29.683272 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:29.683275 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:29.683398 (+ 123us) server_negotiation.cc:407] Connection header received
0811 16:51:29.683432 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:29.683433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:29.683447 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:29.683521 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:29.683771 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.684641 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.686248 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.686916 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.687003 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.687015 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:29.687175 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 16:51:29.687247 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:51:29.687372 31564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.683252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:44167 (local address 127.2.55.129:39369)
0811 16:51:29.683303 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:29.683306 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:29.683315 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:51:29.683397 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:29.683398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:29.683416 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:29.683507 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:29.683775 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.684614 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.686249 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.686909 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.687098 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.687116 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:29.687259 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 16:51:29.687302 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:51:29.687343 31546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.683100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:39369 (local address 127.2.55.131:44167)
0811 16:51:29.683165 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:29.683177 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:29.683225 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:29.683537 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:29.683538 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:29.683539 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:29.683668 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:29.683670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.684719 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.684720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:29.686133 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:29.686136 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.687113 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.687113 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:29.687179 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.687182 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:51:29.687233 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 16:51:29.687272 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":100}
I20260811 16:51:29.687747 31047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "405ef090361447539b99a6cbeac52ff2" candidate_uuid: "b53b323e27e74b2ebf9ae02d168f2d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb5f5bca6484b939f856bc56f1d1cde" is_pre_election: true
I20260811 16:51:29.687777 31260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "405ef090361447539b99a6cbeac52ff2" candidate_uuid: "b53b323e27e74b2ebf9ae02d168f2d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f83b92ca91c444cfaab4ca3d449c5ee0" is_pre_election: true
I20260811 16:51:29.687906 31047 raft_consensus.cc:2454] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b53b323e27e74b2ebf9ae02d168f2d8b in term 0.
I20260811 16:51:29.687963 31260 raft_consensus.cc:2454] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b53b323e27e74b2ebf9ae02d168f2d8b in term 0.
I20260811 16:51:29.688262 31366 leader_election.cc:302] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b53b323e27e74b2ebf9ae02d168f2d8b, f83b92ca91c444cfaab4ca3d449c5ee0; no voters:
I20260811 16:51:29.688403 31585 raft_consensus.cc:2781] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:51:29.688472 31585 raft_consensus.cc:482] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:51:29.688498 31585 raft_consensus.cc:3037] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:29.689365 31585 raft_consensus.cc:504] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53b323e27e74b2ebf9ae02d168f2d8b" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41771 } } peers { permanent_uuid: "f83b92ca91c444cfaab4ca3d449c5ee0" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34569 } } peers { permanent_uuid: "2bb5f5bca6484b939f856bc56f1d1cde" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39369 } }
I20260811 16:51:29.689556 31585 leader_election.cc:288] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [CANDIDATE]: Term 1 election: Requested vote from peers f83b92ca91c444cfaab4ca3d449c5ee0 (127.2.55.130:34569), 2bb5f5bca6484b939f856bc56f1d1cde (127.2.55.129:39369)
I20260811 16:51:29.689735 31260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "405ef090361447539b99a6cbeac52ff2" candidate_uuid: "b53b323e27e74b2ebf9ae02d168f2d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f83b92ca91c444cfaab4ca3d449c5ee0"
I20260811 16:51:29.689780 31047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "405ef090361447539b99a6cbeac52ff2" candidate_uuid: "b53b323e27e74b2ebf9ae02d168f2d8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb5f5bca6484b939f856bc56f1d1cde"
I20260811 16:51:29.689834 31260 raft_consensus.cc:3037] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:29.689858 31047 raft_consensus.cc:3037] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:29.690928 31260 raft_consensus.cc:2454] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b53b323e27e74b2ebf9ae02d168f2d8b in term 1.
I20260811 16:51:29.690925 31047 raft_consensus.cc:2454] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b53b323e27e74b2ebf9ae02d168f2d8b in term 1.
I20260811 16:51:29.691145 31370 leader_election.cc:302] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb5f5bca6484b939f856bc56f1d1cde, b53b323e27e74b2ebf9ae02d168f2d8b; no voters:
I20260811 16:51:29.691259 31585 raft_consensus.cc:2781] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:29.691431 31585 raft_consensus.cc:686] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [term 1 LEADER]: Becoming Leader. State: Replica: b53b323e27e74b2ebf9ae02d168f2d8b, State: Running, Role: LEADER
I20260811 16:51:29.691540 31585 consensus_queue.cc:237] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53b323e27e74b2ebf9ae02d168f2d8b" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41771 } } peers { permanent_uuid: "f83b92ca91c444cfaab4ca3d449c5ee0" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34569 } } peers { permanent_uuid: "2bb5f5bca6484b939f856bc56f1d1cde" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39369 } }
I20260811 16:51:29.692466 30817 catalog_manager.cc:5495] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b reported cstate change: term changed from 0 to 1, leader changed from <none> to b53b323e27e74b2ebf9ae02d168f2d8b (127.2.55.131). New cstate: current_term: 1 leader_uuid: "b53b323e27e74b2ebf9ae02d168f2d8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b53b323e27e74b2ebf9ae02d168f2d8b" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 41771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f83b92ca91c444cfaab4ca3d449c5ee0" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb5f5bca6484b939f856bc56f1d1cde" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39369 } health_report { overall_health: UNKNOWN } } }
I20260811 16:51:29.718747 31566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.716545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57790 (local address 127.2.55.131:41771)
0811 16:51:29.716624 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:29.716625 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:29.716634 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:51:29.716670 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:29.716670 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:29.716688 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:29.716753 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:51:29.716916 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.717382 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.718092 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.718269 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.718321 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.718457 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:51:29.718544 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:51:29.718616 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:29.718662 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 16:51:29.718670 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 16:51:29.720706 31260 raft_consensus.cc:1261] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0 [term 1 FOLLOWER]: Refusing update from remote peer b53b323e27e74b2ebf9ae02d168f2d8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:51:29.720711 31047 raft_consensus.cc:1261] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde [term 1 FOLLOWER]: Refusing update from remote peer b53b323e27e74b2ebf9ae02d168f2d8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:51:29.721120 31588 consensus_queue.cc:1035] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f83b92ca91c444cfaab4ca3d449c5ee0" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:51:29.721258 31585 consensus_queue.cc:1035] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb5f5bca6484b939f856bc56f1d1cde" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:51:29.724002 31593 mvcc.cc:205] Tried to move back new op lower bound from 7317369199492947968 to 7317369199377522688. Current Snapshot: MvccSnapshot[applied={T|T < 7317369199492947968}]
I20260811 16:51:29.725145 31594 mvcc.cc:205] Tried to move back new op lower bound from 7317369199492947968 to 7317369199377522688. Current Snapshot: MvccSnapshot[applied={T|T < 7317369199492947968}]
I20260811 16:51:29.726301 30818 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:51:29.726401 30818 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:51:29.727187 30818 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 10d4a0ce49044a2f883eb77c36dcbf48: Sending DeleteTablet for 3 replicas of tablet 405ef090361447539b99a6cbeac52ff2
I20260811 16:51:29.727562 31444 tablet_service.cc:1514] Processing DeleteTablet for tablet 405ef090361447539b99a6cbeac52ff2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:29 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:57788
I20260811 16:51:29.727583 31223 tablet_service.cc:1514] Processing DeleteTablet for tablet 405ef090361447539b99a6cbeac52ff2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:29 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:53682
I20260811 16:51:29.727780 31021 tablet_service.cc:1514] Processing DeleteTablet for tablet 405ef090361447539b99a6cbeac52ff2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:29 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:34416
I20260811 16:51:29.728006 31608 tablet_replica.cc:330] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde: stopping tablet replica
I20260811 16:51:29.728091 31604 tablet_replica.cc:330] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b: stopping tablet replica
I20260811 16:51:29.728164 31608 raft_consensus.cc:2229] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:51:29.728201 31604 raft_consensus.cc:2229] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:51:29.728302 31608 raft_consensus.cc:2258] T 405ef090361447539b99a6cbeac52ff2 P 2bb5f5bca6484b939f856bc56f1d1cde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:51:29.728302 31604 raft_consensus.cc:2258] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:51:29.728320 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 30913
I20260811 16:51:29.728716 31604 ts_tablet_manager.cc:1905] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:51:29.730506 31607 tablet_replica.cc:330] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0: stopping tablet replica
I20260811 16:51:29.730640 31607 raft_consensus.cc:2229] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:51:29.730739 31607 raft_consensus.cc:2258] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:51:29.730913 31604 ts_tablet_manager.cc:1918] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:51:29.730973 31604 log.cc:1196] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/405ef090361447539b99a6cbeac52ff2
I20260811 16:51:29.731235 31604 ts_tablet_manager.cc:1939] T 405ef090361447539b99a6cbeac52ff2 P b53b323e27e74b2ebf9ae02d168f2d8b: Deleting consensus metadata
I20260811 16:51:29.731591 30802 catalog_manager.cc:4841] TS b53b323e27e74b2ebf9ae02d168f2d8b (127.2.55.131:41771): tablet 405ef090361447539b99a6cbeac52ff2 (table test-table [id=2e3107033ec34c8d8571a9601095de2f]) successfully deleted
I20260811 16:51:29.732038 31607 ts_tablet_manager.cc:1905] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:51:29.733796 31607 ts_tablet_manager.cc:1918] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:51:29.733872 31607 log.cc:1196] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/405ef090361447539b99a6cbeac52ff2
I20260811 16:51:29.734149 31607 ts_tablet_manager.cc:1939] T 405ef090361447539b99a6cbeac52ff2 P f83b92ca91c444cfaab4ca3d449c5ee0: Deleting consensus metadata
I20260811 16:51:29.734577 30798 catalog_manager.cc:4841] TS f83b92ca91c444cfaab4ca3d449c5ee0 (127.2.55.130:34569): tablet 405ef090361447539b99a6cbeac52ff2 (table test-table [id=2e3107033ec34c8d8571a9601095de2f]) successfully deleted
W20260811 16:51:29.748538 30801 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.55.129:39369 (error 108)
I20260811 16:51:29.748771 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 31135
I20260811 16:51:29.753612 31559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.749231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:39369 (local address 127.0.0.1:34430)
0811 16:51:29.753490 (+ 4259us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:29.753555 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:39369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4216}
W20260811 16:51:29.755307 30801 catalog_manager.cc:4584] TS 2bb5f5bca6484b939f856bc56f1d1cde (127.2.55.129:39369): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 405ef090361447539b99a6cbeac52ff2: Network error: Client connection negotiation failed: client connection to 127.2.55.129:39369: connect: Connection refused (error 111)
I20260811 16:51:29.759575 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 31345
I20260811 16:51:29.782608 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 30770
2026-08-11T16:51:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2338 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T16:51:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:29Z Disabled control of system clock
I20260811 16:51:29.819867 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:45371
--webserver_interface=127.2.55.190
--webserver_port=0
--builtin_ntp_servers=127.2.55.148:33137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:45371
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:51:29.905032 31616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:29.905256 31616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:29.905277 31616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:29.906371 31616 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:29.906406 31616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:29.906419 31616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:29.906432 31616 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:29.906445 31616 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:29.907799 31616 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:33137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:45371
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:45371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:29.908000 31616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:29.908237 31616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:29.913566 31625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:29.913607 31616 server_base.cc:1034] running on GCE node
W20260811 16:51:29.913555 31624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:29.913540 31627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:29.914136 31616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:29.914467 31616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:29.915652 31616 hybrid_clock.cc:648] HybridClock initialized: now 1786467089915631 us; error 34 us; skew 500 ppm
I20260811 16:51:29.917191 31616 webserver.cc:460] Webserver started at http://127.2.55.190:42989/ using document root <none> and password file <none>
I20260811 16:51:29.917459 31616 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:29.917574 31616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:29.917727 31616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:29.918886 31616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "3e7a3c6dc0f44d399af8f836f7692fd3"
format_stamp: "Formatted at 2026-08-11 16:51:29 on dist-test-slave-3h5h"
server_key: "9c81211ca60e1f7d6ec07051808986a6"
server_key_iv: "bd0ab719fa0c9de61510c7b53b31266a"
server_key_version: "encryptionkey@0"
I20260811 16:51:29.919305 31616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "3e7a3c6dc0f44d399af8f836f7692fd3"
format_stamp: "Formatted at 2026-08-11 16:51:29 on dist-test-slave-3h5h"
server_key: "9c81211ca60e1f7d6ec07051808986a6"
server_key_iv: "bd0ab719fa0c9de61510c7b53b31266a"
server_key_version: "encryptionkey@0"
I20260811 16:51:29.920732 31616 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:51:29.921568 31633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:29.921751 31616 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:51:29.921865 31616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "3e7a3c6dc0f44d399af8f836f7692fd3"
format_stamp: "Formatted at 2026-08-11 16:51:29 on dist-test-slave-3h5h"
server_key: "9c81211ca60e1f7d6ec07051808986a6"
server_key_iv: "bd0ab719fa0c9de61510c7b53b31266a"
server_key_version: "encryptionkey@0"
I20260811 16:51:29.921944 31616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:29.938585 31616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:29.938962 31616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:29.939139 31616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:29.943713 31616 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:45371
I20260811 16:51:29.943748 31718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:45371 every 8 connection(s)
I20260811 16:51:29.944180 31616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:29.944872 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 31616
I20260811 16:51:29.944995 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:29.945206 2270 external_mini_cluster.cc:1428] Setting key b6ab0b368c24355744ea5a7baaa3ac8c
I20260811 16:51:29.945485 31720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:29.949167 31720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3: Bootstrap starting.
I20260811 16:51:29.949888 31720 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:29.950208 31720 log.cc:824] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:29.951102 31720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3: No bootstrap required, opened a new log
I20260811 16:51:29.951953 31725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:29.945868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48526 (local address 127.2.55.190:45371)
0811 16:51:29.946111 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:29.946121 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:29.946155 (+ 34us) server_negotiation.cc:407] Connection header received
0811 16:51:29.946738 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:29.946747 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:29.946832 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:29.946985 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:29.947240 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.948588 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.949607 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:29.950239 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:29.950373 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:29.951285 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:29.951290 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:29.951290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:29.951456 (+ 166us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:29.951491 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:29.951507 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:29.951586 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:29.951691 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 16:51:29.951775 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":102,"threads_started":1}
I20260811 16:51:29.953289 31720 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7a3c6dc0f44d399af8f836f7692fd3" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45371 } }
I20260811 16:51:29.953423 31720 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:29.953446 31720 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e7a3c6dc0f44d399af8f836f7692fd3, State: Initialized, Role: FOLLOWER
I20260811 16:51:29.953593 31720 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7a3c6dc0f44d399af8f836f7692fd3" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45371 } }
I20260811 16:51:29.953660 31720 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:29.953719 31720 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:29.953775 31720 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:29.954321 31720 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7a3c6dc0f44d399af8f836f7692fd3" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45371 } }
I20260811 16:51:29.954411 31720 leader_election.cc:302] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e7a3c6dc0f44d399af8f836f7692fd3; no voters:
I20260811 16:51:29.954623 31720 leader_election.cc:288] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:29.954659 31728 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:29.954828 31728 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [term 1 LEADER]: Becoming Leader. State: Replica: 3e7a3c6dc0f44d399af8f836f7692fd3, State: Running, Role: LEADER
I20260811 16:51:29.954941 31720 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:29.954937 31728 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7a3c6dc0f44d399af8f836f7692fd3" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45371 } }
I20260811 16:51:29.955358 31731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e7a3c6dc0f44d399af8f836f7692fd3. Latest consensus state: current_term: 1 leader_uuid: "3e7a3c6dc0f44d399af8f836f7692fd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7a3c6dc0f44d399af8f836f7692fd3" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45371 } } }
I20260811 16:51:29.955365 31730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e7a3c6dc0f44d399af8f836f7692fd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7a3c6dc0f44d399af8f836f7692fd3" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45371 } } }
I20260811 16:51:29.955467 31731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:29.955470 31730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:29.955685 31738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:29.956225 31738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:29.957757 31738 catalog_manager.cc:1347] Generated new cluster ID: 4333fe66c426492aa0b372f57d37276f
I20260811 16:51:29.957811 31738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:29.969075 31738 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:29.969812 31738 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:29.974612 31738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3: Generated new TSK 0
I20260811 16:51:29.974807 31738 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:29.977281 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:45371
--builtin_ntp_servers=127.2.55.148:33137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:51:30.069864 31756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:30.070111 31756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:30.070138 31756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:30.071466 31756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:30.071513 31756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:30.071542 31756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:51:30.073182 31756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:33137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:45371
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:30.073484 31756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:30.073879 31756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:30.080355 31766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:30.080354 31765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:30.080354 31768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:30.080600 31756 server_base.cc:1034] running on GCE node
I20260811 16:51:30.080979 31756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:30.081281 31756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:30.082502 31756 hybrid_clock.cc:648] HybridClock initialized: now 1786467090082478 us; error 35 us; skew 500 ppm
I20260811 16:51:30.083946 31756 webserver.cc:460] Webserver started at http://127.2.55.129:32861/ using document root <none> and password file <none>
I20260811 16:51:30.084271 31756 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:30.084352 31756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:30.084525 31756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:30.085786 31756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "3490ad6446b14452b8e9ccb4f6e003a9"
format_stamp: "Formatted at 2026-08-11 16:51:30 on dist-test-slave-3h5h"
server_key: "a8f0a9b084cd16a6e17632f77af0acf2"
server_key_iv: "2c7b56d1a9fb8d064c8b804893d0029b"
server_key_version: "encryptionkey@0"
I20260811 16:51:30.086191 31756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "3490ad6446b14452b8e9ccb4f6e003a9"
format_stamp: "Formatted at 2026-08-11 16:51:30 on dist-test-slave-3h5h"
server_key: "a8f0a9b084cd16a6e17632f77af0acf2"
server_key_iv: "2c7b56d1a9fb8d064c8b804893d0029b"
server_key_version: "encryptionkey@0"
I20260811 16:51:30.087697 31756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:51:30.088526 31776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:30.088752 31756 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:30.088886 31756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "3490ad6446b14452b8e9ccb4f6e003a9"
format_stamp: "Formatted at 2026-08-11 16:51:30 on dist-test-slave-3h5h"
server_key: "a8f0a9b084cd16a6e17632f77af0acf2"
server_key_iv: "2c7b56d1a9fb8d064c8b804893d0029b"
server_key_version: "encryptionkey@0"
I20260811 16:51:30.088984 31756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:30.113173 31756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:30.113597 31756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:30.113806 31756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:30.114092 31756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:30.114451 31756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:30.114514 31756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:30.114558 31756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:30.114585 31756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:30.120644 31756 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:39755
I20260811 16:51:30.120750 31952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:39755 every 8 connection(s)
I20260811 16:51:30.121117 31756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:51:30.124123 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 31756
I20260811 16:51:30.124244 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:51:30.124480 2270 external_mini_cluster.cc:1428] Setting key 82da839aaee73c8ccb5c18dd50da86d8
I20260811 16:51:30.125725 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:45371
--builtin_ntp_servers=127.2.55.148:33137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 16:51:30.127115 31725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.121930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:32801 (local address 127.2.55.190:45371)
0811 16:51:30.122025 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:30.122027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:30.122256 (+ 229us) server_negotiation.cc:407] Connection header received
0811 16:51:30.122770 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:30.122771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:30.122781 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:30.122834 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:30.123480 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.123991 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.125413 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.125661 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.125731 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.126737 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:30.126740 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:30.126740 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:30.126746 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:30.126766 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:30.126772 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:30.126847 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:30.127017 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 16:51:30.127048 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 16:51:30.127336 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.121889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:45371 (local address 127.2.55.129:32801)
0811 16:51:30.122127 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:30.122163 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:30.122678 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:30.122888 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:30.122891 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:30.122899 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:30.123406 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:30.123411 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.124106 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.124107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:30.125319 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:30.125323 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.125774 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.125775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:30.125939 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.126508 (+ 569us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:51:30.126509 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:30.126548 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:51:30.126580 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:30.126870 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:30.126877 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:30.126880 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:51:30.126942 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 16:51:30.127067 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":113,"threads_started":1}
I20260811 16:51:30.127933 31953 heartbeater.cc:347] Connected to a master server at 127.2.55.190:45371
I20260811 16:51:30.128082 31953 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:30.128311 31953 heartbeater.cc:511] Master 127.2.55.190:45371 requested a full tablet report, sending...
I20260811 16:51:30.129038 31663 ts_manager.cc:194] Registered new tserver with Master: 3490ad6446b14452b8e9ccb4f6e003a9 (127.2.55.129:39755)
I20260811 16:51:30.129683 31663 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.55.129:32801
W20260811 16:51:30.221540 31956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:30.221788 31956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:30.221824 31956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:30.222968 31956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:30.223043 31956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:30.223097 31956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:51:30.224468 31956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:33137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:45371
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:30.224733 31956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:30.225073 31956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:30.230434 31971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:30.230494 31967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:30.230652 31956 server_base.cc:1034] running on GCE node
W20260811 16:51:30.230434 31966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:30.231014 31956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:30.231274 31956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:30.232419 31956 hybrid_clock.cc:648] HybridClock initialized: now 1786467090232383 us; error 53 us; skew 500 ppm
I20260811 16:51:30.233866 31956 webserver.cc:460] Webserver started at http://127.2.55.130:34461/ using document root <none> and password file <none>
I20260811 16:51:30.234122 31956 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:30.234171 31956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:30.234338 31956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:30.235436 31956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "7aa5cdcb03324623966d80df3309e7d8"
format_stamp: "Formatted at 2026-08-11 16:51:30 on dist-test-slave-3h5h"
server_key: "9bae6310e46a1ce80ee25d29e05644d7"
server_key_iv: "b9da269894ab83a0a866c586acb89213"
server_key_version: "encryptionkey@0"
I20260811 16:51:30.235795 31956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "7aa5cdcb03324623966d80df3309e7d8"
format_stamp: "Formatted at 2026-08-11 16:51:30 on dist-test-slave-3h5h"
server_key: "9bae6310e46a1ce80ee25d29e05644d7"
server_key_iv: "b9da269894ab83a0a866c586acb89213"
server_key_version: "encryptionkey@0"
I20260811 16:51:30.237293 31956 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:51:30.238066 31979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:30.238263 31956 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:51:30.238353 31956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "7aa5cdcb03324623966d80df3309e7d8"
format_stamp: "Formatted at 2026-08-11 16:51:30 on dist-test-slave-3h5h"
server_key: "9bae6310e46a1ce80ee25d29e05644d7"
server_key_iv: "b9da269894ab83a0a866c586acb89213"
server_key_version: "encryptionkey@0"
I20260811 16:51:30.238406 31956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:30.245492 31956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:30.245760 31956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:30.245859 31956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:30.246053 31956 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:30.246330 31956 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:30.246359 31956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:30.246379 31956 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:30.246397 31956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:30.252143 31956 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:43359
I20260811 16:51:30.252223 32157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:43359 every 8 connection(s)
I20260811 16:51:30.252596 31956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:51:30.253007 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 31956
I20260811 16:51:30.253144 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:51:30.253333 2270 external_mini_cluster.cc:1428] Setting key b184493ace4036c224c87703ca7c6efd
I20260811 16:51:30.254561 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:45371
--builtin_ntp_servers=127.2.55.148:33137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 16:51:30.258756 31725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.253519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:36101 (local address 127.2.55.190:45371)
0811 16:51:30.253582 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:30.253584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:30.254027 (+ 443us) server_negotiation.cc:407] Connection header received
0811 16:51:30.254636 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:30.254637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:30.254650 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:30.254721 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:30.255463 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.256147 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.257278 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.257471 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.257549 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.258444 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:30.258446 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:30.258446 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:30.258451 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:30.258465 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:30.258469 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:30.258523 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:30.258638 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 16:51:30.258665 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 16:51:30.258973 32161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.253440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:45371 (local address 127.2.55.130:36101)
0811 16:51:30.253902 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:30.253937 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:30.254517 (+ 580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:30.254803 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:30.254807 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:30.254816 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:30.255350 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:30.255355 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.256251 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.256254 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:30.257170 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:30.257173 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.257557 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.257558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:30.257697 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.258291 (+ 594us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:51:30.258292 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:30.258322 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:51:30.258347 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:30.258531 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:30.258536 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:30.258539 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:51:30.258625 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 16:51:30.258732 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":114,"threads_started":1}
I20260811 16:51:30.259559 32159 heartbeater.cc:347] Connected to a master server at 127.2.55.190:45371
I20260811 16:51:30.259684 32159 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:30.259877 32159 heartbeater.cc:511] Master 127.2.55.190:45371 requested a full tablet report, sending...
I20260811 16:51:30.260340 31663 ts_manager.cc:194] Registered new tserver with Master: 7aa5cdcb03324623966d80df3309e7d8 (127.2.55.130:43359)
I20260811 16:51:30.260921 31663 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.55.130:36101
W20260811 16:51:30.339924 32162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:30.340196 32162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:30.340219 32162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:30.341471 32162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:30.341518 32162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:30.341543 32162 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:51:30.342943 32162 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:33137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:45371
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:30.343143 32162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:30.343396 32162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:30.348596 32170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:30.348618 32162 server_base.cc:1034] running on GCE node
W20260811 16:51:30.348601 32169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:30.348603 32172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:30.349116 32162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:30.349368 32162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:30.350515 32162 hybrid_clock.cc:648] HybridClock initialized: now 1786467090350506 us; error 35 us; skew 500 ppm
I20260811 16:51:30.351699 32162 webserver.cc:460] Webserver started at http://127.2.55.131:35121/ using document root <none> and password file <none>
I20260811 16:51:30.351950 32162 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:30.351996 32162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:30.352151 32162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:30.353380 32162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "6d30da36aab74e2ea936b054fbae241f"
format_stamp: "Formatted at 2026-08-11 16:51:30 on dist-test-slave-3h5h"
server_key: "3033e712a01adc494889ec3e61787523"
server_key_iv: "0207da5c25cd29c80124b3d012102108"
server_key_version: "encryptionkey@0"
I20260811 16:51:30.353768 32162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "6d30da36aab74e2ea936b054fbae241f"
format_stamp: "Formatted at 2026-08-11 16:51:30 on dist-test-slave-3h5h"
server_key: "3033e712a01adc494889ec3e61787523"
server_key_iv: "0207da5c25cd29c80124b3d012102108"
server_key_version: "encryptionkey@0"
I20260811 16:51:30.355346 32162 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 16:51:30.356240 32181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:30.356420 32162 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:30.356513 32162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "6d30da36aab74e2ea936b054fbae241f"
format_stamp: "Formatted at 2026-08-11 16:51:30 on dist-test-slave-3h5h"
server_key: "3033e712a01adc494889ec3e61787523"
server_key_iv: "0207da5c25cd29c80124b3d012102108"
server_key_version: "encryptionkey@0"
I20260811 16:51:30.356570 32162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:30.380307 32162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:30.380734 32162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:30.380924 32162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:30.381181 32162 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:30.381569 32162 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:30.381629 32162 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:30.381672 32162 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:30.381702 32162 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:30.387398 32162 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:35351
I20260811 16:51:30.387486 32362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:35351 every 8 connection(s)
I20260811 16:51:30.387861 32162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:51:30.390955 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 32162
I20260811 16:51:30.391077 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:51:30.391299 2270 external_mini_cluster.cc:1428] Setting key 1a19cd388a30f66362a3c6144b525f09
I20260811 16:51:30.393604 31725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.388645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:51365 (local address 127.2.55.190:45371)
0811 16:51:30.388741 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:30.388744 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:30.389018 (+ 274us) server_negotiation.cc:407] Connection header received
0811 16:51:30.389488 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:30.389489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:30.389503 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:30.389553 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:30.390222 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.390771 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.392025 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.392320 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.392406 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.393338 (+ 932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:30.393339 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:30.393339 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:30.393344 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:30.393359 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:30.393363 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:30.393419 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:30.393498 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 16:51:30.393525 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 16:51:30.393877 32368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.388612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:45371 (local address 127.2.55.131:51365)
0811 16:51:30.388856 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:30.388913 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:30.389403 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:30.389615 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:30.389618 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:30.389626 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:30.390136 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:30.390141 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.390864 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.390865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:30.391941 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:30.391944 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.392417 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.392419 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:30.392566 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.393191 (+ 625us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:51:30.393191 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:30.393219 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:51:30.393243 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:30.393421 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:30.393426 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:30.393429 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:51:30.393500 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 16:51:30.393604 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":68,"threads_started":1}
I20260811 16:51:30.394387 32364 heartbeater.cc:347] Connected to a master server at 127.2.55.190:45371
I20260811 16:51:30.394469 32364 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:30.394673 32364 heartbeater.cc:511] Master 127.2.55.190:45371 requested a full tablet report, sending...
I20260811 16:51:30.395045 31663 ts_manager.cc:194] Registered new tserver with Master: 6d30da36aab74e2ea936b054fbae241f (127.2.55.131:35351)
I20260811 16:51:30.395460 31663 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.55.131:51365
I20260811 16:51:30.403294 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:51:30.407553 31725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.404767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48528 (local address 127.2.55.190:45371)
0811 16:51:30.404827 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:30.404829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:30.404954 (+ 125us) server_negotiation.cc:407] Connection header received
0811 16:51:30.404994 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:30.404995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:30.405003 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:30.405052 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:30.405161 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.405626 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.406361 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.406554 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.406616 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.407305 (+ 689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:30.407306 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:30.407306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:30.407310 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:30.407323 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:30.407327 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:30.407404 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:30.407477 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 16:51:30.407487 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:51:30.409418 31663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48528:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:51:30.411039 31663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:51:30.417572 32382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.413416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58682 (local address 127.2.55.131:35351)
0811 16:51:30.413597 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:30.413603 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:30.413613 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:51:30.413654 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:30.413656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:30.413674 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:30.413824 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:30.413985 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.415328 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.416538 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.417169 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.417258 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.417349 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:30.417445 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 16:51:30.417481 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
I20260811 16:51:30.417559 32376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.413301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:35351 (local address 127.0.0.1:58682)
0811 16:51:30.413434 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:30.413472 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:30.413542 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:30.413835 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:30.413838 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:30.413841 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:30.413907 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:30.413909 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.415420 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.415421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:30.416450 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:30.416451 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.417261 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.417262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:30.417340 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.417354 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:51:30.417431 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 16:51:30.417485 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":82,"threads_started":1}
I20260811 16:51:30.417872 32377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.413556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:39755 (local address 127.0.0.1:48162)
0811 16:51:30.413820 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:30.413831 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:30.413886 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:30.414144 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:30.414145 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:30.414147 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:30.414194 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:30.414196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.415080 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.415081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:30.416369 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:30.416372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.417441 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.417442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:30.417503 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.417507 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:51:30.417557 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 16:51:30.417598 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":81,"threads_started":1}
I20260811 16:51:30.418200 32388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.413792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48162 (local address 127.2.55.129:39755)
0811 16:51:30.413981 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:30.413986 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:30.413995 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:51:30.414032 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:30.414034 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:30.414055 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:30.414144 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:30.414251 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.414992 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.416474 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.417240 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.417313 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.417401 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:30.418065 (+ 664us) server_negotiation.cc:299] Negotiation successful
0811 16:51:30.418111 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":96,"threads_started":1}
I20260811 16:51:30.418438 32265 tablet_service.cc:1467] Processing CreateTablet for tablet 03bbd952414643cba8ace0c64d917e8a (DEFAULT_TABLE table=test-table [id=1795ef517ab64d4da55ff150bc488816]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:30.418864 32265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03bbd952414643cba8ace0c64d917e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:30.418944 31851 tablet_service.cc:1467] Processing CreateTablet for tablet 03bbd952414643cba8ace0c64d917e8a (DEFAULT_TABLE table=test-table [id=1795ef517ab64d4da55ff150bc488816]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:30.419409 31851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03bbd952414643cba8ace0c64d917e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:30.420994 32384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.413305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:43359 (local address 127.0.0.1:45944)
0811 16:51:30.413682 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:30.413692 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:30.413746 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:30.414390 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:30.414391 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:30.414394 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:30.414432 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:30.414433 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.415632 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.415633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:30.416647 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:30.416650 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.417777 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.417778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:30.417838 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.417842 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:51:30.417888 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 16:51:30.417930 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":112,"threads_started":1}
I20260811 16:51:30.421185 32386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.413614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45944 (local address 127.2.55.130:43359)
0811 16:51:30.414021 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:30.414026 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:30.414035 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:51:30.414220 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:30.414222 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:30.414242 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:30.414321 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:30.414525 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.415538 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.416744 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.417498 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.417565 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.420961 (+ 3396us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:30.420995 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 16:51:30.421067 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":101,"threads_started":1}
I20260811 16:51:30.422230 32392 tablet_bootstrap.cc:492] T 03bbd952414643cba8ace0c64d917e8a P 3490ad6446b14452b8e9ccb4f6e003a9: Bootstrap starting.
I20260811 16:51:30.422256 32390 tablet_bootstrap.cc:492] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f: Bootstrap starting.
I20260811 16:51:30.422976 32392 tablet_bootstrap.cc:654] T 03bbd952414643cba8ace0c64d917e8a P 3490ad6446b14452b8e9ccb4f6e003a9: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:30.423071 32390 tablet_bootstrap.cc:654] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:30.422957 32058 tablet_service.cc:1467] Processing CreateTablet for tablet 03bbd952414643cba8ace0c64d917e8a (DEFAULT_TABLE table=test-table [id=1795ef517ab64d4da55ff150bc488816]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:30.423310 32392 log.cc:824] T 03bbd952414643cba8ace0c64d917e8a P 3490ad6446b14452b8e9ccb4f6e003a9: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:30.423336 32058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03bbd952414643cba8ace0c64d917e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:30.423426 32390 log.cc:824] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:30.424237 32390 tablet_bootstrap.cc:492] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f: No bootstrap required, opened a new log
I20260811 16:51:30.424248 32392 tablet_bootstrap.cc:492] T 03bbd952414643cba8ace0c64d917e8a P 3490ad6446b14452b8e9ccb4f6e003a9: No bootstrap required, opened a new log
I20260811 16:51:30.424324 32392 ts_tablet_manager.cc:1397] T 03bbd952414643cba8ace0c64d917e8a P 3490ad6446b14452b8e9ccb4f6e003a9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:51:30.424382 32390 ts_tablet_manager.cc:1397] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:51:30.426349 32395 tablet_bootstrap.cc:492] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8: Bootstrap starting.
I20260811 16:51:30.427100 32395 tablet_bootstrap.cc:654] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:30.427414 32395 log.cc:824] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:30.427572 32390 raft_consensus.cc:348] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7aa5cdcb03324623966d80df3309e7d8" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43359 } } peers { permanent_uuid: "6d30da36aab74e2ea936b054fbae241f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35351 } } peers { permanent_uuid: "3490ad6446b14452b8e9ccb4f6e003a9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39755 } }
I20260811 16:51:30.427561 32392 raft_consensus.cc:348] T 03bbd952414643cba8ace0c64d917e8a P 3490ad6446b14452b8e9ccb4f6e003a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7aa5cdcb03324623966d80df3309e7d8" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43359 } } peers { permanent_uuid: "6d30da36aab74e2ea936b054fbae241f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35351 } } peers { permanent_uuid: "3490ad6446b14452b8e9ccb4f6e003a9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39755 } }
I20260811 16:51:30.427763 32392 raft_consensus.cc:374] T 03bbd952414643cba8ace0c64d917e8a P 3490ad6446b14452b8e9ccb4f6e003a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:30.427763 32390 raft_consensus.cc:374] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:30.427820 32390 raft_consensus.cc:729] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d30da36aab74e2ea936b054fbae241f, State: Initialized, Role: FOLLOWER
I20260811 16:51:30.427820 32392 raft_consensus.cc:729] T 03bbd952414643cba8ace0c64d917e8a P 3490ad6446b14452b8e9ccb4f6e003a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3490ad6446b14452b8e9ccb4f6e003a9, State: Initialized, Role: FOLLOWER
I20260811 16:51:30.427982 32390 consensus_queue.cc:260] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7aa5cdcb03324623966d80df3309e7d8" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43359 } } peers { permanent_uuid: "6d30da36aab74e2ea936b054fbae241f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35351 } } peers { permanent_uuid: "3490ad6446b14452b8e9ccb4f6e003a9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39755 } }
I20260811 16:51:30.427982 32392 consensus_queue.cc:260] T 03bbd952414643cba8ace0c64d917e8a P 3490ad6446b14452b8e9ccb4f6e003a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7aa5cdcb03324623966d80df3309e7d8" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43359 } } peers { permanent_uuid: "6d30da36aab74e2ea936b054fbae241f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35351 } } peers { permanent_uuid: "3490ad6446b14452b8e9ccb4f6e003a9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39755 } }
I20260811 16:51:30.428212 32395 tablet_bootstrap.cc:492] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8: No bootstrap required, opened a new log
I20260811 16:51:30.428305 32395 ts_tablet_manager.cc:1397] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:51:30.428303 32390 ts_tablet_manager.cc:1428] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 16:51:30.428296 32392 ts_tablet_manager.cc:1428] T 03bbd952414643cba8ace0c64d917e8a P 3490ad6446b14452b8e9ccb4f6e003a9: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 16:51:30.428437 32364 heartbeater.cc:503] Master 127.2.55.190:45371 was elected leader, sending a full tablet report...
I20260811 16:51:30.428469 31953 heartbeater.cc:503] Master 127.2.55.190:45371 was elected leader, sending a full tablet report...
I20260811 16:51:30.430650 32395 raft_consensus.cc:348] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7aa5cdcb03324623966d80df3309e7d8" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43359 } } peers { permanent_uuid: "6d30da36aab74e2ea936b054fbae241f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35351 } } peers { permanent_uuid: "3490ad6446b14452b8e9ccb4f6e003a9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39755 } }
I20260811 16:51:30.430797 32395 raft_consensus.cc:374] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:30.430842 32395 raft_consensus.cc:729] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa5cdcb03324623966d80df3309e7d8, State: Initialized, Role: FOLLOWER
I20260811 16:51:30.430953 32395 consensus_queue.cc:260] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7aa5cdcb03324623966d80df3309e7d8" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43359 } } peers { permanent_uuid: "6d30da36aab74e2ea936b054fbae241f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35351 } } peers { permanent_uuid: "3490ad6446b14452b8e9ccb4f6e003a9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39755 } }
I20260811 16:51:30.431205 32395 ts_tablet_manager.cc:1428] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:51:30.431294 32159 heartbeater.cc:503] Master 127.2.55.190:45371 was elected leader, sending a full tablet report...
W20260811 16:51:30.504062 32160 tablet.cc:2369] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:51:30.621898 31954 tablet.cc:2369] T 03bbd952414643cba8ace0c64d917e8a P 3490ad6446b14452b8e9ccb4f6e003a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:51:30.638484 32367 tablet.cc:2369] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:51:30.663200 32404 raft_consensus.cc:482] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:51:30.663385 32404 raft_consensus.cc:504] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7aa5cdcb03324623966d80df3309e7d8" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43359 } } peers { permanent_uuid: "6d30da36aab74e2ea936b054fbae241f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35351 } } peers { permanent_uuid: "3490ad6446b14452b8e9ccb4f6e003a9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39755 } }
I20260811 16:51:30.664000 32404 leader_election.cc:288] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d30da36aab74e2ea936b054fbae241f (127.2.55.131:35351), 3490ad6446b14452b8e9ccb4f6e003a9 (127.2.55.129:39755)
I20260811 16:51:30.668772 32388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.664348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:43209 (local address 127.2.55.129:39755)
0811 16:51:30.664428 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:30.664431 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:30.664443 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:51:30.664501 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:30.664502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:30.664514 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:30.664581 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:30.664817 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.665702 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.667596 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.668216 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.668326 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.668337 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:30.668597 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 16:51:30.668688 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 16:51:30.668756 32161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.664245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:39755 (local address 127.2.55.130:43209)
0811 16:51:30.664298 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:30.664313 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:30.664373 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:30.664616 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:30.664617 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:30.664619 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:30.664703 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:30.664704 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.665870 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.665871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:30.667454 (+ 1583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:30.667458 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.668350 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.668352 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:30.668468 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.668474 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:51:30.668556 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 16:51:30.668618 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":80}
I20260811 16:51:30.668795 32382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.664365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:43059 (local address 127.2.55.131:35351)
0811 16:51:30.664428 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:30.664431 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:30.664632 (+ 201us) server_negotiation.cc:407] Connection header received
0811 16:51:30.664670 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:30.664671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:30.664683 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:30.664746 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:30.664997 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.665755 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.667597 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.668333 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.668415 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.668422 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:30.668674 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 16:51:30.668726 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:51:30.668763 32408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.664266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:35351 (local address 127.2.55.130:43059)
0811 16:51:30.664522 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:30.664531 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:30.664607 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:30.664767 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:30.664768 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:30.664770 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:30.664894 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:30.664897 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.665870 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.665871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:30.667454 (+ 1583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:30.667458 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.668442 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.668443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:30.668567 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.668571 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:51:30.668629 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 16:51:30.668661 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":66,"thread_start_us":137,"threads_started":1}
I20260811 16:51:30.669353 31880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03bbd952414643cba8ace0c64d917e8a" candidate_uuid: "7aa5cdcb03324623966d80df3309e7d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3490ad6446b14452b8e9ccb4f6e003a9" is_pre_election: true
I20260811 16:51:30.669483 32296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03bbd952414643cba8ace0c64d917e8a" candidate_uuid: "7aa5cdcb03324623966d80df3309e7d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d30da36aab74e2ea936b054fbae241f" is_pre_election: true
I20260811 16:51:30.669555 31880 raft_consensus.cc:2454] T 03bbd952414643cba8ace0c64d917e8a P 3490ad6446b14452b8e9ccb4f6e003a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7aa5cdcb03324623966d80df3309e7d8 in term 0.
I20260811 16:51:30.669643 32296 raft_consensus.cc:2454] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7aa5cdcb03324623966d80df3309e7d8 in term 0.
I20260811 16:51:30.669854 31980 leader_election.cc:302] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3490ad6446b14452b8e9ccb4f6e003a9, 7aa5cdcb03324623966d80df3309e7d8; no voters:
I20260811 16:51:30.670101 32404 raft_consensus.cc:2781] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:51:30.670179 32404 raft_consensus.cc:482] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:51:30.670199 32404 raft_consensus.cc:3037] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:30.670964 32404 raft_consensus.cc:504] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7aa5cdcb03324623966d80df3309e7d8" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43359 } } peers { permanent_uuid: "6d30da36aab74e2ea936b054fbae241f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35351 } } peers { permanent_uuid: "3490ad6446b14452b8e9ccb4f6e003a9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39755 } }
I20260811 16:51:30.671150 32404 leader_election.cc:288] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [CANDIDATE]: Term 1 election: Requested vote from peers 6d30da36aab74e2ea936b054fbae241f (127.2.55.131:35351), 3490ad6446b14452b8e9ccb4f6e003a9 (127.2.55.129:39755)
I20260811 16:51:30.671321 32296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03bbd952414643cba8ace0c64d917e8a" candidate_uuid: "7aa5cdcb03324623966d80df3309e7d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d30da36aab74e2ea936b054fbae241f"
I20260811 16:51:30.671345 31880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03bbd952414643cba8ace0c64d917e8a" candidate_uuid: "7aa5cdcb03324623966d80df3309e7d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3490ad6446b14452b8e9ccb4f6e003a9"
I20260811 16:51:30.671429 31880 raft_consensus.cc:3037] T 03bbd952414643cba8ace0c64d917e8a P 3490ad6446b14452b8e9ccb4f6e003a9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:30.671437 32296 raft_consensus.cc:3037] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:30.672245 32296 raft_consensus.cc:2454] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa5cdcb03324623966d80df3309e7d8 in term 1.
I20260811 16:51:30.672514 31981 leader_election.cc:302] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d30da36aab74e2ea936b054fbae241f, 7aa5cdcb03324623966d80df3309e7d8; no voters:
I20260811 16:51:30.672572 31880 raft_consensus.cc:2454] T 03bbd952414643cba8ace0c64d917e8a P 3490ad6446b14452b8e9ccb4f6e003a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa5cdcb03324623966d80df3309e7d8 in term 1.
I20260811 16:51:30.672683 32404 raft_consensus.cc:2781] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:30.672899 32404 raft_consensus.cc:686] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [term 1 LEADER]: Becoming Leader. State: Replica: 7aa5cdcb03324623966d80df3309e7d8, State: Running, Role: LEADER
I20260811 16:51:30.673044 32404 consensus_queue.cc:237] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7aa5cdcb03324623966d80df3309e7d8" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43359 } } peers { permanent_uuid: "6d30da36aab74e2ea936b054fbae241f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35351 } } peers { permanent_uuid: "3490ad6446b14452b8e9ccb4f6e003a9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39755 } }
I20260811 16:51:30.674050 31663 catalog_manager.cc:5495] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7aa5cdcb03324623966d80df3309e7d8 (127.2.55.130). New cstate: current_term: 1 leader_uuid: "7aa5cdcb03324623966d80df3309e7d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7aa5cdcb03324623966d80df3309e7d8" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d30da36aab74e2ea936b054fbae241f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3490ad6446b14452b8e9ccb4f6e003a9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39755 } health_report { overall_health: UNKNOWN } } }
I20260811 16:51:30.702154 32386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.699589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45960 (local address 127.2.55.130:43359)
0811 16:51:30.699666 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:30.699669 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:30.699690 (+ 21us) server_negotiation.cc:407] Connection header received
0811 16:51:30.699731 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:30.699732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:30.699754 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:30.699826 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:51:30.700015 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.700507 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.701318 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:30.701567 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:30.701638 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:30.701758 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:51:30.701853 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:51:30.701938 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:30.701980 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 16:51:30.701988 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 16:51:30.704656 31880 raft_consensus.cc:1261] T 03bbd952414643cba8ace0c64d917e8a P 3490ad6446b14452b8e9ccb4f6e003a9 [term 1 FOLLOWER]: Refusing update from remote peer 7aa5cdcb03324623966d80df3309e7d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:51:30.704690 32296 raft_consensus.cc:1261] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f [term 1 FOLLOWER]: Refusing update from remote peer 7aa5cdcb03324623966d80df3309e7d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:51:30.705147 32409 consensus_queue.cc:1035] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d30da36aab74e2ea936b054fbae241f" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 35351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:51:30.705318 32404 consensus_queue.cc:1035] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3490ad6446b14452b8e9ccb4f6e003a9" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:51:30.707892 32413 mvcc.cc:205] Tried to move back new op lower bound from 7317369203522064384 to 7317369203397320704. Current Snapshot: MvccSnapshot[applied={T|T < 7317369203522064384}]
I20260811 16:51:30.708240 32414 mvcc.cc:205] Tried to move back new op lower bound from 7317369203522064384 to 7317369203397320704. Current Snapshot: MvccSnapshot[applied={T|T < 7317369203522064384}]
I20260811 16:51:30.708345 32417 mvcc.cc:205] Tried to move back new op lower bound from 7317369203522064384 to 7317369203397320704. Current Snapshot: MvccSnapshot[applied={T|T < 7317369203522064384}]
I20260811 16:51:30.711162 31657 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48528:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:51:30.711288 31657 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48528:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:51:30.712095 31657 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e7a3c6dc0f44d399af8f836f7692fd3: Sending DeleteTablet for 3 replicas of tablet 03bbd952414643cba8ace0c64d917e8a
I20260811 16:51:30.712474 32265 tablet_service.cc:1514] Processing DeleteTablet for tablet 03bbd952414643cba8ace0c64d917e8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:30 UTC) from {username='slave'} at 127.0.0.1:58682
I20260811 16:51:30.712483 31851 tablet_service.cc:1514] Processing DeleteTablet for tablet 03bbd952414643cba8ace0c64d917e8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:30 UTC) from {username='slave'} at 127.0.0.1:48162
I20260811 16:51:30.712481 32058 tablet_service.cc:1514] Processing DeleteTablet for tablet 03bbd952414643cba8ace0c64d917e8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:30 UTC) from {username='slave'} at 127.0.0.1:45944
I20260811 16:51:30.712726 32431 tablet_replica.cc:330] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f: stopping tablet replica
I20260811 16:51:30.712935 32428 tablet_replica.cc:330] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8: stopping tablet replica
I20260811 16:51:30.713042 32428 raft_consensus.cc:2229] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:51:30.713130 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 31756
I20260811 16:51:30.713177 32428 raft_consensus.cc:2258] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:51:30.725137 32431 raft_consensus.cc:2229] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:51:30.725345 32431 raft_consensus.cc:2258] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:51:30.725778 32428 ts_tablet_manager.cc:1905] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:51:30.728006 32428 ts_tablet_manager.cc:1918] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:51:30.728096 32428 log.cc:1196] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/03bbd952414643cba8ace0c64d917e8a
I20260811 16:51:30.728369 32428 ts_tablet_manager.cc:1939] T 03bbd952414643cba8ace0c64d917e8a P 7aa5cdcb03324623966d80df3309e7d8: Deleting consensus metadata
I20260811 16:51:30.729097 32431 ts_tablet_manager.cc:1905] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:51:30.730331 31634 catalog_manager.cc:4841] TS 7aa5cdcb03324623966d80df3309e7d8 (127.2.55.130:43359): tablet 03bbd952414643cba8ace0c64d917e8a (table test-table [id=1795ef517ab64d4da55ff150bc488816]) successfully deleted
W20260811 16:51:30.730561 31634 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.55.129:39755 (error 108)
I20260811 16:51:30.731048 32431 ts_tablet_manager.cc:1918] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:51:30.731086 32384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:30.730921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:39755 (local address 127.0.0.1:48172)
0811 16:51:30.730989 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:30.731043 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:39755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 16:51:30.731129 32431 log.cc:1196] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/03bbd952414643cba8ace0c64d917e8a
W20260811 16:51:30.731216 31634 catalog_manager.cc:4584] TS 3490ad6446b14452b8e9ccb4f6e003a9 (127.2.55.129:39755): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 03bbd952414643cba8ace0c64d917e8a: Network error: Client connection negotiation failed: client connection to 127.2.55.129:39755: connect: Connection refused (error 111)
I20260811 16:51:30.731400 32431 ts_tablet_manager.cc:1939] T 03bbd952414643cba8ace0c64d917e8a P 6d30da36aab74e2ea936b054fbae241f: Deleting consensus metadata
I20260811 16:51:30.731530 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 31956
I20260811 16:51:30.736924 31635 catalog_manager.cc:4841] TS 6d30da36aab74e2ea936b054fbae241f (127.2.55.131:35351): tablet 03bbd952414643cba8ace0c64d917e8a (table test-table [id=1795ef517ab64d4da55ff150bc488816]) successfully deleted
I20260811 16:51:30.744948 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 32162
I20260811 16:51:30.759002 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 31616
2026-08-11T16:51:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (975 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:30 dist-test-slave-3h5h krb5kdc[32439](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:30 dist-test-slave-3h5h krb5kdc[32439](info): set up 2 sockets
Aug 11 16:51:30 dist-test-slave-3h5h krb5kdc[32439](info): commencing operation
krb5kdc: starting...
W20260811 16:51:32.054605 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:32 dist-test-slave-3h5h krb5kdc[32439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:51:32.189548 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:38721
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:37419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:38721
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:32.277007 32457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:32.277274 32457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:32.277314 32457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:32.278487 32457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:32.278565 32457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:32.278590 32457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:32.278617 32457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:32.278648 32457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:32.280164 32457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:37419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:38721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:38721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:32.280476 32457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:32.280717 32457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:32.285889 32465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:32.286106 32457 server_base.cc:1034] running on GCE node
W20260811 16:51:32.285903 32470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:32.286125 32466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:32.286538 32457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:32.286873 32457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:32.288092 32457 hybrid_clock.cc:648] HybridClock initialized: now 1786467092288050 us; error 61 us; skew 500 ppm
Aug 11 16:51:32 dist-test-slave-3h5h krb5kdc[32439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467092, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:32.291045 32457 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:51:32.291527 32457 webserver.cc:460] Webserver started at http://127.2.55.190:46637/ using document root <none> and password file <none>
I20260811 16:51:32.291733 32457 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:32.291776 32457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:32.291947 32457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:32.293175 32457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "3b1a45d5e26847c7b421548884e0c029"
format_stamp: "Formatted at 2026-08-11 16:51:32 on dist-test-slave-3h5h"
server_key: "befa6526f4a2a8200a990f043817ce0e"
server_key_iv: "63bf1dba1d4fa00388d7b3beaf83e625"
server_key_version: "encryptionkey@0"
I20260811 16:51:32.293532 32457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "3b1a45d5e26847c7b421548884e0c029"
format_stamp: "Formatted at 2026-08-11 16:51:32 on dist-test-slave-3h5h"
server_key: "befa6526f4a2a8200a990f043817ce0e"
server_key_iv: "63bf1dba1d4fa00388d7b3beaf83e625"
server_key_version: "encryptionkey@0"
I20260811 16:51:32.294975 32457 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:32.295794 32478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:32.296080 32457 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:32.296198 32457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "3b1a45d5e26847c7b421548884e0c029"
format_stamp: "Formatted at 2026-08-11 16:51:32 on dist-test-slave-3h5h"
server_key: "befa6526f4a2a8200a990f043817ce0e"
server_key_iv: "63bf1dba1d4fa00388d7b3beaf83e625"
server_key_version: "encryptionkey@0"
I20260811 16:51:32.296305 32457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:32.306219 32457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:32.308734 32457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:32.308974 32457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:32.314016 32457 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:38721
I20260811 16:51:32.314086 32561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:38721 every 8 connection(s)
I20260811 16:51:32.314519 32457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:32.315423 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 32457
I20260811 16:51:32.315572 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:32.315711 32562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:32.315842 2270 external_mini_cluster.cc:1428] Setting key 94d04f0cde88820a20b3252e123de424
I20260811 16:51:32.318922 32562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029: Bootstrap starting.
I20260811 16:51:32.319697 32562 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:32.320102 32562 log.cc:824] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:32.320992 32562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029: No bootstrap required, opened a new log
Aug 11 16:51:32 dist-test-slave-3h5h krb5kdc[32439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:51:32.323657 32562 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1a45d5e26847c7b421548884e0c029" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 38721 } }
I20260811 16:51:32.323802 32562 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:32.323827 32562 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b1a45d5e26847c7b421548884e0c029, State: Initialized, Role: FOLLOWER
I20260811 16:51:32.323989 32562 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1a45d5e26847c7b421548884e0c029" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 38721 } }
I20260811 16:51:32.324105 32562 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:32.324152 32562 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:32.324223 32562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:32.325038 32562 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1a45d5e26847c7b421548884e0c029" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 38721 } }
I20260811 16:51:32.325137 32562 leader_election.cc:302] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b1a45d5e26847c7b421548884e0c029; no voters:
I20260811 16:51:32.325387 32562 leader_election.cc:288] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:32.325451 32571 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:32.325651 32571 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [term 1 LEADER]: Becoming Leader. State: Replica: 3b1a45d5e26847c7b421548884e0c029, State: Running, Role: LEADER
I20260811 16:51:32.325686 32562 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:32.325762 32571 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1a45d5e26847c7b421548884e0c029" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 38721 } }
I20260811 16:51:32.326084 32571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b1a45d5e26847c7b421548884e0c029. Latest consensus state: current_term: 1 leader_uuid: "3b1a45d5e26847c7b421548884e0c029" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1a45d5e26847c7b421548884e0c029" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 38721 } } }
I20260811 16:51:32.326167 32571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:32.326102 32572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b1a45d5e26847c7b421548884e0c029" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b1a45d5e26847c7b421548884e0c029" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 38721 } } }
I20260811 16:51:32.326375 32572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:32.326391 32578 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:32.327395 32578 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:32.328220 32569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:32.316431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35022 (local address 127.2.55.190:38721)
0811 16:51:32.316639 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:32.316650 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:32.316688 (+ 38us) server_negotiation.cc:407] Connection header received
0811 16:51:32.317275 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:32.317284 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:32.317346 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:32.317494 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:32.318185 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.319117 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.319927 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.320589 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.320720 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:32.323621 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:32.323624 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:32.323625 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:32.323636 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:32.325843 (+ 2207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:32.326301 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:32.326304 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:32.326304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:32.326414 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:32.326646 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:32.326647 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:32.326647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:32.326958 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:32.327602 (+ 644us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:32.327855 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 16:51:32.327998 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":82,"threads_started":1}
I20260811 16:51:32.329649 32578 catalog_manager.cc:1347] Generated new cluster ID: 972b6d4e52d64a83a5bce382c7d582f5
I20260811 16:51:32.329704 32578 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:32.349871 32578 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:32.350468 32578 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:32.353073 32578 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029: Generated new TSK 0
I20260811 16:51:32.353255 32578 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.55.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
Entry for principal kudu/127.2.55.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab.
I20260811 16:51:32.387439 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:38721
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:37419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:32.472049 32608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:32.472294 32608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:32.472333 32608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:32.473549 32608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:32.473619 32608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:32.473664 32608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:51:32.475198 32608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:37419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.129.keytab
--principal=kudu/127.2.55.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:38721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:32.475476 32608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:32.475733 32608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:32.481254 32619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:32.481263 32618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:32.481456 32608 server_base.cc:1034] running on GCE node
W20260811 16:51:32.481254 32621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:32.481768 32608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:32.482113 32608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:32.483297 32608 hybrid_clock.cc:648] HybridClock initialized: now 1786467092483276 us; error 48 us; skew 500 ppm
Aug 11 16:51:32 dist-test-slave-3h5h krb5kdc[32439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467092, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:32.486351 32608 init.cc:377] Logged in from keytab as kudu/127.2.55.129@KRBTEST.COM (short username kudu)
I20260811 16:51:32.486788 32608 webserver.cc:460] Webserver started at http://127.2.55.129:43353/ using document root <none> and password file <none>
I20260811 16:51:32.487043 32608 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:32.487088 32608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:32.487200 32608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:32.488361 32608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "6b331ca3968a4539a534b639bafe3cd2"
format_stamp: "Formatted at 2026-08-11 16:51:32 on dist-test-slave-3h5h"
server_key: "d0ae5944dbd7f8d1640f450eed85f6fb"
server_key_iv: "f27612e5d97ddab5d95a9b21acb99754"
server_key_version: "encryptionkey@0"
I20260811 16:51:32.488690 32608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "6b331ca3968a4539a534b639bafe3cd2"
format_stamp: "Formatted at 2026-08-11 16:51:32 on dist-test-slave-3h5h"
server_key: "d0ae5944dbd7f8d1640f450eed85f6fb"
server_key_iv: "f27612e5d97ddab5d95a9b21acb99754"
server_key_version: "encryptionkey@0"
I20260811 16:51:32.490367 32608 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:51:32.491267 32628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:32.491489 32608 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 16:51:32.491602 32608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "6b331ca3968a4539a534b639bafe3cd2"
format_stamp: "Formatted at 2026-08-11 16:51:32 on dist-test-slave-3h5h"
server_key: "d0ae5944dbd7f8d1640f450eed85f6fb"
server_key_iv: "f27612e5d97ddab5d95a9b21acb99754"
server_key_version: "encryptionkey@0"
I20260811 16:51:32.491689 32608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:32.500914 32608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:32.503273 32608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:32.503437 32608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:32.503686 32608 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:32.504016 32608 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:32.504081 32608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:32.504144 32608 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:32.504169 32608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:32.510179 32608 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:45777
I20260811 16:51:32.510272 329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:45777 every 8 connection(s)
I20260811 16:51:32.510598 32608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:51:32.513743 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 32608
I20260811 16:51:32.513855 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:51:32.514091 2270 external_mini_cluster.cc:1428] Setting key fa84736ef1fdd2fb4e256f24c7afdcd1
Aug 11 16:51:32 dist-test-slave-3h5h krb5kdc[32439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467092, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.129@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:51:32.520942 32569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:32.511393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:51663 (local address 127.2.55.190:38721)
0811 16:51:32.511458 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:32.511460 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:32.511661 (+ 201us) server_negotiation.cc:407] Connection header received
0811 16:51:32.512137 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:32.512138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:32.512148 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:32.512218 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:32.513267 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.513981 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.515034 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.515340 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.515414 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:32.517807 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:32.517809 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:32.517810 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:32.517819 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:32.519301 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:32.519749 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:32.519750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:32.519750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:32.519817 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:32.520116 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:32.520117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:32.520118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:32.520259 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:32.520326 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:32.520712 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 16:51:32.520797 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 16:51:32.521239 338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:32.511349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:38721 (local address 127.2.55.129:51663)
0811 16:51:32.511519 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:32.511570 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:32.512054 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:32.512299 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:32.512302 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:32.512986 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:32.513184 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:32.513189 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.514083 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.514084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:32.514948 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:32.514951 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.515469 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.515470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:32.515627 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:32.516232 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:51:32.516242 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:32.517701 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:32.519412 (+ 1711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:32.519421 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:32.519423 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:32.519659 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:32.519889 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:32.519889 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:32.519890 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:32.520038 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:32.520343 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:32.520352 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:32.520545 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 16:51:32.520688 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 16:51:32.520928 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":87,"threads_started":1}
I20260811 16:51:32.521868 331 heartbeater.cc:347] Connected to a master server at 127.2.55.190:38721
I20260811 16:51:32.521973 331 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:32.522181 331 heartbeater.cc:511] Master 127.2.55.190:38721 requested a full tablet report, sending...
I20260811 16:51:32.522730 32504 ts_manager.cc:194] Registered new tserver with Master: 6b331ca3968a4539a534b639bafe3cd2 (127.2.55.129:45777)
I20260811 16:51:32.523361 32504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.129@KRBTEST.COM'} at 127.2.55.129:51663
WARNING: no policy specified for kudu/127.2.55.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
Entry for principal kudu/127.2.55.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab.
I20260811 16:51:32.544531 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:38721
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:37419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:32.629253 342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:32.629459 342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:32.629484 342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:32.630735 342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:32.630781 342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:32.630836 342 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:51:32.632318 342 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:37419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.130.keytab
--principal=kudu/127.2.55.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:38721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:32.632572 342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:32.632845 342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:32.638195 353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:32.638180 352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:32.638211 342 server_base.cc:1034] running on GCE node
W20260811 16:51:32.638168 355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:32.638656 342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:32.638916 342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:32.640120 342 hybrid_clock.cc:648] HybridClock initialized: now 1786467092640105 us; error 40 us; skew 500 ppm
Aug 11 16:51:32 dist-test-slave-3h5h krb5kdc[32439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467092, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:32.642839 342 init.cc:377] Logged in from keytab as kudu/127.2.55.130@KRBTEST.COM (short username kudu)
I20260811 16:51:32.643435 342 webserver.cc:460] Webserver started at http://127.2.55.130:44493/ using document root <none> and password file <none>
I20260811 16:51:32.643718 342 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:32.643793 342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:32.643962 342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:32.645177 342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "b55b303a61114ea0abe113a6811d6630"
format_stamp: "Formatted at 2026-08-11 16:51:32 on dist-test-slave-3h5h"
server_key: "616485c85d766b5dc679af57d2071361"
server_key_iv: "1744e48dc21138ef1646fe424648498e"
server_key_version: "encryptionkey@0"
I20260811 16:51:32.645568 342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "b55b303a61114ea0abe113a6811d6630"
format_stamp: "Formatted at 2026-08-11 16:51:32 on dist-test-slave-3h5h"
server_key: "616485c85d766b5dc679af57d2071361"
server_key_iv: "1744e48dc21138ef1646fe424648498e"
server_key_version: "encryptionkey@0"
I20260811 16:51:32.647064 342 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:51:32.647809 363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:32.647980 342 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:51:32.648102 342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "b55b303a61114ea0abe113a6811d6630"
format_stamp: "Formatted at 2026-08-11 16:51:32 on dist-test-slave-3h5h"
server_key: "616485c85d766b5dc679af57d2071361"
server_key_iv: "1744e48dc21138ef1646fe424648498e"
server_key_version: "encryptionkey@0"
I20260811 16:51:32.648185 342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:32.666970 342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:32.669461 342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:32.669651 342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:32.670027 342 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:32.670459 342 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:32.670516 342 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:32.670564 342 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:32.670608 342 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:32.677474 342 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:43501
I20260811 16:51:32.677559 541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:43501 every 8 connection(s)
I20260811 16:51:32.677930 342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:51:32.680747 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 342
I20260811 16:51:32.680907 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:51:32.681149 2270 external_mini_cluster.cc:1428] Setting key 4b4eafe2775c4177ec53857df82d394b
Aug 11 16:51:32 dist-test-slave-3h5h krb5kdc[32439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467092, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.130@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:51:32.689955 32569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:32.678809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:34509 (local address 127.2.55.190:38721)
0811 16:51:32.678896 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:32.678899 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:32.679088 (+ 189us) server_negotiation.cc:407] Connection header received
0811 16:51:32.679604 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:32.679606 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:32.679618 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:32.679686 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:32.680715 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.681515 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.682854 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.683162 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.683240 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:32.686357 (+ 3117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:32.686358 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:32.686358 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:32.686366 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:32.687971 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:32.688610 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:32.688611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:32.688611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:32.688663 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:32.689208 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:32.689210 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:32.689210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:32.689346 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:32.689422 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:32.689813 (+ 391us) server_negotiation.cc:299] Negotiation successful
0811 16:51:32.689886 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 16:51:32.690280 546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:32.678765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:38721 (local address 127.2.55.130:34509)
0811 16:51:32.678950 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:32.678989 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:32.679480 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:32.679770 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:32.679774 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:32.680377 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:32.680584 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:32.680589 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.681642 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.681643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:32.682750 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:32.682753 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.683261 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.683262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:32.683371 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:32.683989 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:51:32.684002 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:32.686250 (+ 2248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:32.688101 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:32.688108 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:32.688110 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:32.688522 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:32.688785 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:32.688787 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:32.688787 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:32.688994 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:32.689432 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:32.689441 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:32.689637 (+ 196us) client_negotiation.cc:769] Sending connection context
0811 16:51:32.689778 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 16:51:32.689988 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":107,"threads_started":1}
I20260811 16:51:32.690937 543 heartbeater.cc:347] Connected to a master server at 127.2.55.190:38721
I20260811 16:51:32.691038 543 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:32.691255 543 heartbeater.cc:511] Master 127.2.55.190:38721 requested a full tablet report, sending...
I20260811 16:51:32.691726 32504 ts_manager.cc:194] Registered new tserver with Master: b55b303a61114ea0abe113a6811d6630 (127.2.55.130:43501)
I20260811 16:51:32.692210 32504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.130@KRBTEST.COM'} at 127.2.55.130:34509
WARNING: no policy specified for kudu/127.2.55.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
Entry for principal kudu/127.2.55.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab.
I20260811 16:51:32.712389 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:38721
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:37419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:32.795914 550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:32.796118 550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:32.796140 550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:32.797348 550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:32.797390 550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:32.797417 550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:51:32.798967 550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:37419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.131.keytab
--principal=kudu/127.2.55.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:38721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.550
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:32.799222 550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:32.799458 550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:32.804927 557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:32.805090 550 server_base.cc:1034] running on GCE node
W20260811 16:51:32.804893 559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:32.805265 556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:32.805513 550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:32.805720 550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:32.806887 550 hybrid_clock.cc:648] HybridClock initialized: now 1786467092806876 us; error 29 us; skew 500 ppm
Aug 11 16:51:32 dist-test-slave-3h5h krb5kdc[32439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467092, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:32.809609 550 init.cc:377] Logged in from keytab as kudu/127.2.55.131@KRBTEST.COM (short username kudu)
I20260811 16:51:32.810057 550 webserver.cc:460] Webserver started at http://127.2.55.131:37493/ using document root <none> and password file <none>
I20260811 16:51:32.810295 550 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:32.810341 550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:32.810510 550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:32.811578 550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "3689f34794aa4009b6d16f78f7d1ece0"
format_stamp: "Formatted at 2026-08-11 16:51:32 on dist-test-slave-3h5h"
server_key: "9c1c3cd62b07afb444c9d584ec9fd94a"
server_key_iv: "dbb894a96ddc47fb9fd3a09dc40df480"
server_key_version: "encryptionkey@0"
I20260811 16:51:32.811946 550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "3689f34794aa4009b6d16f78f7d1ece0"
format_stamp: "Formatted at 2026-08-11 16:51:32 on dist-test-slave-3h5h"
server_key: "9c1c3cd62b07afb444c9d584ec9fd94a"
server_key_iv: "dbb894a96ddc47fb9fd3a09dc40df480"
server_key_version: "encryptionkey@0"
I20260811 16:51:32.813371 550 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:51:32.814174 573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:32.814358 550 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:51:32.814469 550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "3689f34794aa4009b6d16f78f7d1ece0"
format_stamp: "Formatted at 2026-08-11 16:51:32 on dist-test-slave-3h5h"
server_key: "9c1c3cd62b07afb444c9d584ec9fd94a"
server_key_iv: "dbb894a96ddc47fb9fd3a09dc40df480"
server_key_version: "encryptionkey@0"
I20260811 16:51:32.814548 550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:32.835510 550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:32.837738 550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:32.837913 550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:32.838174 550 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:32.838539 550 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:32.838596 550 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:32.838644 550 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:32.838668 550 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:32.844704 550 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:38679
I20260811 16:51:32.844754 761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:38679 every 8 connection(s)
I20260811 16:51:32.845115 550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:51:32.848281 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 550
I20260811 16:51:32.848388 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:51:32.848590 2270 external_mini_cluster.cc:1428] Setting key b63616fc012d859e6ee3ffaec6b5f360
Aug 11 16:51:32 dist-test-slave-3h5h krb5kdc[32439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467092, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.131@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:51:32.855665 32569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:32.845909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:60941 (local address 127.2.55.190:38721)
0811 16:51:32.846001 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:32.846004 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:32.846199 (+ 195us) server_negotiation.cc:407] Connection header received
0811 16:51:32.846678 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:32.846679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:32.846690 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:32.846751 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:32.847716 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.848445 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.849944 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.850152 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.850226 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:32.852516 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:32.852518 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:32.852519 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:32.852528 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:32.854212 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:32.854690 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:32.854692 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:32.854692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:32.854756 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:32.855049 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:32.855050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:32.855050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:32.855186 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:32.855253 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:32.855502 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 16:51:32.855598 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 16:51:32.855823 764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:32.845887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:38721 (local address 127.2.55.131:60941)
0811 16:51:32.846061 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:32.846104 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:32.846581 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:32.846804 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:32.846808 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:32.847394 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:32.847596 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:32.847601 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.848595 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.848596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:32.849862 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:32.849865 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.850246 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.850247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:32.850345 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:32.850853 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:51:32.850862 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:32.852367 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:32.854322 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:32.854330 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:32.854332 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:32.854590 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:32.854838 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:51:32.854839 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:51:32.854839 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:51:32.854962 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:51:32.855256 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:32.855260 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:32.855384 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 16:51:32.855471 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 16:51:32.855603 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":99,"threads_started":1}
I20260811 16:51:32.856375 762 heartbeater.cc:347] Connected to a master server at 127.2.55.190:38721
I20260811 16:51:32.856505 762 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:32.856743 762 heartbeater.cc:511] Master 127.2.55.190:38721 requested a full tablet report, sending...
I20260811 16:51:32.857156 32504 ts_manager.cc:194] Registered new tserver with Master: 3689f34794aa4009b6d16f78f7d1ece0 (127.2.55.131:38679)
I20260811 16:51:32.857499 32504 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.55.131@KRBTEST.COM'} at 127.2.55.131:60941
I20260811 16:51:32.861029 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:51:32.869454 32569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:32.862553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35026 (local address 127.2.55.190:38721)
0811 16:51:32.862610 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:32.862612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:32.862679 (+ 67us) server_negotiation.cc:407] Connection header received
0811 16:51:32.862716 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:32.862717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:32.862725 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:32.862780 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:32.863314 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.863806 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.864573 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.864796 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.865029 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:32.866302 (+ 1273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:32.866304 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:32.866304 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:32.866312 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:32.868128 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:32.868464 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:32.868465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:32.868465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:32.868530 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:32.868734 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:32.868734 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:32.868734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:32.869078 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:32.869181 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:32.869300 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 16:51:32.869378 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 16:51:32.871341 32504 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35026:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:51:32.873023 32504 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:51:32.880200 782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:32.875839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43420 (local address 127.2.55.129:45777)
0811 16:51:32.876274 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:32.876278 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:32.876287 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:51:32.876325 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:32.876327 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:32.876653 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:32.876763 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:32.876872 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.877943 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.879129 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.879818 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.879900 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:32.879961 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:32.880066 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 16:51:32.880111 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":124,"threads_started":1}
I20260811 16:51:32.880211 779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:32.875690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:45777 (local address 127.0.0.1:43420)
0811 16:51:32.875827 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:32.875869 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:32.875933 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:32.876759 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:32.876760 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:32.876763 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:32.876798 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:32.876799 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.878035 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.878036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:32.879034 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:32.879037 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.879909 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.879910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:32.879971 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:32.879983 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 16:51:32.880052 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 16:51:32.880104 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":6,"thread_start_us":83,"threads_started":1}
I20260811 16:51:32.880559 787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:32.876186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:38679 (local address 127.0.0.1:57572)
0811 16:51:32.876308 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:32.876320 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:32.876367 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:32.876656 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:32.876658 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:32.876660 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:32.876718 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:32.876720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.877831 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.877832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:32.879273 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:32.879276 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.880176 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.880177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:32.880236 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:32.880240 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:51:32.880444 (+ 204us) client_negotiation.cc:240] Negotiation successful
0811 16:51:32.880494 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":60,"thread_start_us":76,"threads_started":1}
I20260811 16:51:32.880638 788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:32.876297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57572 (local address 127.2.55.131:38679)
0811 16:51:32.876489 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:32.876493 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:32.876500 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:51:32.876541 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:32.876542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:32.876555 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:32.876641 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:32.876799 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.877549 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.879366 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.880086 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.880158 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:32.880222 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:32.880474 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 16:51:32.880553 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":85,"threads_started":1}
I20260811 16:51:32.881345 658 tablet_service.cc:1467] Processing CreateTablet for tablet e41089b9b1a74a04941d01bb3bac18de (DEFAULT_TABLE table=test-table [id=41f0301eb6ea461a98b8b146a701906f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:32.881343 32698 tablet_service.cc:1467] Processing CreateTablet for tablet e41089b9b1a74a04941d01bb3bac18de (DEFAULT_TABLE table=test-table [id=41f0301eb6ea461a98b8b146a701906f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:32.881668 785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:32.875921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:43501 (local address 127.0.0.1:36270)
0811 16:51:32.876058 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:32.876068 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:32.876119 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:32.876507 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:32.876510 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:32.876514 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:32.876587 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:32.876589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.877973 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.877973 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:32.879280 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:32.879282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.881411 (+ 2129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.881412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:32.881477 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:32.881481 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:51:32.881551 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 16:51:32.881595 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":43,"thread_start_us":156,"threads_started":1}
I20260811 16:51:32.881742 32698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e41089b9b1a74a04941d01bb3bac18de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:32.881742 658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e41089b9b1a74a04941d01bb3bac18de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:32.881922 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:32.876046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36270 (local address 127.2.55.130:43501)
0811 16:51:32.876232 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:32.876237 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:32.876251 (+ 14us) server_negotiation.cc:407] Connection header received
0811 16:51:32.876297 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:32.876299 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:32.876316 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:32.876404 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:32.876680 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.877866 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.880263 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:32.881320 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:32.881410 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:32.881461 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:32.881648 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 16:51:32.881691 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":97,"threads_started":1}
I20260811 16:51:32.885257 791 tablet_bootstrap.cc:492] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0: Bootstrap starting.
I20260811 16:51:32.885555 432 tablet_service.cc:1467] Processing CreateTablet for tablet e41089b9b1a74a04941d01bb3bac18de (DEFAULT_TABLE table=test-table [id=41f0301eb6ea461a98b8b146a701906f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:32.885926 432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e41089b9b1a74a04941d01bb3bac18de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:32.885998 791 tablet_bootstrap.cc:654] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:32.886605 791 log.cc:824] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:32.886966 794 tablet_bootstrap.cc:492] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2: Bootstrap starting.
I20260811 16:51:32.887437 791 tablet_bootstrap.cc:492] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0: No bootstrap required, opened a new log
I20260811 16:51:32.887521 791 ts_tablet_manager.cc:1397] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:51:32.887665 794 tablet_bootstrap.cc:654] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:32.888255 794 log.cc:824] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:32.889129 794 tablet_bootstrap.cc:492] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2: No bootstrap required, opened a new log
I20260811 16:51:32.889215 794 ts_tablet_manager.cc:1397] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:51:32.889333 791 raft_consensus.cc:348] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b331ca3968a4539a534b639bafe3cd2" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45777 } } peers { permanent_uuid: "b55b303a61114ea0abe113a6811d6630" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43501 } } peers { permanent_uuid: "3689f34794aa4009b6d16f78f7d1ece0" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 38679 } }
I20260811 16:51:32.889526 791 raft_consensus.cc:374] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:32.889573 791 raft_consensus.cc:729] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3689f34794aa4009b6d16f78f7d1ece0, State: Initialized, Role: FOLLOWER
I20260811 16:51:32.889705 797 tablet_bootstrap.cc:492] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630: Bootstrap starting.
I20260811 16:51:32.889714 791 consensus_queue.cc:260] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b331ca3968a4539a534b639bafe3cd2" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45777 } } peers { permanent_uuid: "b55b303a61114ea0abe113a6811d6630" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43501 } } peers { permanent_uuid: "3689f34794aa4009b6d16f78f7d1ece0" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 38679 } }
I20260811 16:51:32.890034 791 ts_tablet_manager.cc:1428] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:51:32.890087 762 heartbeater.cc:503] Master 127.2.55.190:38721 was elected leader, sending a full tablet report...
I20260811 16:51:32.890496 797 tablet_bootstrap.cc:654] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:32.891064 797 log.cc:824] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:32.891559 794 raft_consensus.cc:348] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b331ca3968a4539a534b639bafe3cd2" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45777 } } peers { permanent_uuid: "b55b303a61114ea0abe113a6811d6630" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43501 } } peers { permanent_uuid: "3689f34794aa4009b6d16f78f7d1ece0" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 38679 } }
I20260811 16:51:32.891688 794 raft_consensus.cc:374] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:32.891711 794 raft_consensus.cc:729] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b331ca3968a4539a534b639bafe3cd2, State: Initialized, Role: FOLLOWER
I20260811 16:51:32.891873 797 tablet_bootstrap.cc:492] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630: No bootstrap required, opened a new log
I20260811 16:51:32.891841 794 consensus_queue.cc:260] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b331ca3968a4539a534b639bafe3cd2" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45777 } } peers { permanent_uuid: "b55b303a61114ea0abe113a6811d6630" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43501 } } peers { permanent_uuid: "3689f34794aa4009b6d16f78f7d1ece0" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 38679 } }
I20260811 16:51:32.891943 797 ts_tablet_manager.cc:1397] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:51:32.892143 794 ts_tablet_manager.cc:1428] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 16:51:32.892158 331 heartbeater.cc:503] Master 127.2.55.190:38721 was elected leader, sending a full tablet report...
I20260811 16:51:32.893831 797 raft_consensus.cc:348] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b331ca3968a4539a534b639bafe3cd2" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45777 } } peers { permanent_uuid: "b55b303a61114ea0abe113a6811d6630" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43501 } } peers { permanent_uuid: "3689f34794aa4009b6d16f78f7d1ece0" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 38679 } }
I20260811 16:51:32.894011 797 raft_consensus.cc:374] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:32.894065 797 raft_consensus.cc:729] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b55b303a61114ea0abe113a6811d6630, State: Initialized, Role: FOLLOWER
I20260811 16:51:32.894186 797 consensus_queue.cc:260] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b331ca3968a4539a534b639bafe3cd2" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45777 } } peers { permanent_uuid: "b55b303a61114ea0abe113a6811d6630" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43501 } } peers { permanent_uuid: "3689f34794aa4009b6d16f78f7d1ece0" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 38679 } }
I20260811 16:51:32.894486 797 ts_tablet_manager.cc:1428] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:51:32.894501 543 heartbeater.cc:503] Master 127.2.55.190:38721 was elected leader, sending a full tablet report...
W20260811 16:51:32.928606 544 tablet.cc:2369] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:51:33.011482 335 tablet.cc:2369] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:51:33.061771 802 raft_consensus.cc:482] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:51:33.061913 802 raft_consensus.cc:504] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b331ca3968a4539a534b639bafe3cd2" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45777 } } peers { permanent_uuid: "b55b303a61114ea0abe113a6811d6630" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43501 } } peers { permanent_uuid: "3689f34794aa4009b6d16f78f7d1ece0" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 38679 } }
I20260811 16:51:33.062511 802 leader_election.cc:288] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b55b303a61114ea0abe113a6811d6630 (127.2.55.130:43501), 3689f34794aa4009b6d16f78f7d1ece0 (127.2.55.131:38679)
I20260811 16:51:33.065739 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.062889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:42609 (local address 127.2.55.130:43501)
0811 16:51:33.062958 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:33.062960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:33.063123 (+ 163us) server_negotiation.cc:407] Connection header received
0811 16:51:33.063156 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:33.063157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:33.063172 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:33.063241 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:33.063426 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.063921 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.064938 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.065353 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.065446 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.065456 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:33.065633 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 16:51:33.065673 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 16:51:33.065757 810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.062794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:43501 (local address 127.2.55.129:42609)
0811 16:51:33.062920 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:33.062934 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:33.062985 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:33.063267 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:33.063269 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:33.063272 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:33.063348 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.063350 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.064013 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.064014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.064790 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.064793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.065448 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.065449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.065538 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.065542 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:51:33.065622 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 16:51:33.065666 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":71,"threads_started":1}
I20260811 16:51:33.066193 811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.062997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:38679 (local address 127.2.55.129:53867)
0811 16:51:33.063122 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:33.063153 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:33.063206 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:33.063367 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:33.063368 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:33.063370 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:33.063464 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.063466 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.064244 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.064245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.065194 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.065196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.065914 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.065915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.065984 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.065987 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:51:33.066066 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 16:51:33.066107 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":49,"threads_started":1}
I20260811 16:51:33.066192 788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.063110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:53867 (local address 127.2.55.131:38679)
0811 16:51:33.063194 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:33.063197 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:33.063209 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:51:33.063268 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:33.063270 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:33.063284 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:33.063347 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:33.063547 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.064077 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.065294 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.065726 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.065830 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.065842 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:33.066074 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 16:51:33.066125 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 16:51:33.066177 465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e41089b9b1a74a04941d01bb3bac18de" candidate_uuid: "6b331ca3968a4539a534b639bafe3cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b55b303a61114ea0abe113a6811d6630" is_pre_election: true
I20260811 16:51:33.066354 465 raft_consensus.cc:2454] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b331ca3968a4539a534b639bafe3cd2 in term 0.
I20260811 16:51:33.066507 686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e41089b9b1a74a04941d01bb3bac18de" candidate_uuid: "6b331ca3968a4539a534b639bafe3cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3689f34794aa4009b6d16f78f7d1ece0" is_pre_election: true
I20260811 16:51:33.066682 32632 leader_election.cc:302] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b331ca3968a4539a534b639bafe3cd2, b55b303a61114ea0abe113a6811d6630; no voters:
I20260811 16:51:33.066689 686 raft_consensus.cc:2454] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b331ca3968a4539a534b639bafe3cd2 in term 0.
I20260811 16:51:33.066846 802 raft_consensus.cc:2781] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:51:33.066928 802 raft_consensus.cc:482] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:51:33.066947 802 raft_consensus.cc:3037] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:33.067737 802 raft_consensus.cc:504] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b331ca3968a4539a534b639bafe3cd2" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45777 } } peers { permanent_uuid: "b55b303a61114ea0abe113a6811d6630" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43501 } } peers { permanent_uuid: "3689f34794aa4009b6d16f78f7d1ece0" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 38679 } }
I20260811 16:51:33.067875 802 leader_election.cc:288] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [CANDIDATE]: Term 1 election: Requested vote from peers b55b303a61114ea0abe113a6811d6630 (127.2.55.130:43501), 3689f34794aa4009b6d16f78f7d1ece0 (127.2.55.131:38679)
I20260811 16:51:33.068053 465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e41089b9b1a74a04941d01bb3bac18de" candidate_uuid: "6b331ca3968a4539a534b639bafe3cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b55b303a61114ea0abe113a6811d6630"
I20260811 16:51:33.068084 686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e41089b9b1a74a04941d01bb3bac18de" candidate_uuid: "6b331ca3968a4539a534b639bafe3cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3689f34794aa4009b6d16f78f7d1ece0"
I20260811 16:51:33.068141 465 raft_consensus.cc:3037] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:33.068161 686 raft_consensus.cc:3037] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:33.068953 465 raft_consensus.cc:2454] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b331ca3968a4539a534b639bafe3cd2 in term 1.
I20260811 16:51:33.069130 32632 leader_election.cc:302] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b331ca3968a4539a534b639bafe3cd2, b55b303a61114ea0abe113a6811d6630; no voters:
I20260811 16:51:33.069216 686 raft_consensus.cc:2454] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b331ca3968a4539a534b639bafe3cd2 in term 1.
I20260811 16:51:33.069242 802 raft_consensus.cc:2781] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:33.069411 802 raft_consensus.cc:686] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 6b331ca3968a4539a534b639bafe3cd2, State: Running, Role: LEADER
I20260811 16:51:33.069519 802 consensus_queue.cc:237] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b331ca3968a4539a534b639bafe3cd2" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45777 } } peers { permanent_uuid: "b55b303a61114ea0abe113a6811d6630" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43501 } } peers { permanent_uuid: "3689f34794aa4009b6d16f78f7d1ece0" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 38679 } }
I20260811 16:51:33.070385 32504 catalog_manager.cc:5495] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b331ca3968a4539a534b639bafe3cd2 (127.2.55.129). New cstate: current_term: 1 leader_uuid: "6b331ca3968a4539a534b639bafe3cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b331ca3968a4539a534b639bafe3cd2" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 45777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b55b303a61114ea0abe113a6811d6630" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3689f34794aa4009b6d16f78f7d1ece0" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 38679 } health_report { overall_health: UNKNOWN } } }
W20260811 16:51:33.095708 763 tablet.cc:2369] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:51:33.109634 782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.107284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43434 (local address 127.2.55.129:45777)
0811 16:51:33.107346 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:33.107348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:33.107358 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:51:33.107408 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:33.107409 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:33.107430 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:33.107493 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:51:33.107632 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.108102 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.108937 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.109123 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.109192 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.109336 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:51:33.109440 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:51:33.109502 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:33.109554 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 16:51:33.109573 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:51:33.111788 465 raft_consensus.cc:1261] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630 [term 1 FOLLOWER]: Refusing update from remote peer 6b331ca3968a4539a534b639bafe3cd2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:51:33.111788 686 raft_consensus.cc:1261] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0 [term 1 FOLLOWER]: Refusing update from remote peer 6b331ca3968a4539a534b639bafe3cd2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:51:33.112247 802 consensus_queue.cc:1035] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b55b303a61114ea0abe113a6811d6630" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 43501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:51:33.112416 813 consensus_queue.cc:1035] T e41089b9b1a74a04941d01bb3bac18de P 6b331ca3968a4539a534b639bafe3cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3689f34794aa4009b6d16f78f7d1ece0" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 38679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:51:33.114959 816 mvcc.cc:205] Tried to move back new op lower bound from 7317369213382344704 to 7317369213213364224. Current Snapshot: MvccSnapshot[applied={T|T < 7317369213382344704}]
I20260811 16:51:33.115706 820 mvcc.cc:205] Tried to move back new op lower bound from 7317369213382344704 to 7317369213213364224. Current Snapshot: MvccSnapshot[applied={T|T < 7317369213382344704 or (T in {7317369213382344704})}]
I20260811 16:51:33.115979 819 mvcc.cc:205] Tried to move back new op lower bound from 7317369213382344704 to 7317369213213364224. Current Snapshot: MvccSnapshot[applied={T|T < 7317369213382344704}]
I20260811 16:51:33.118213 32504 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:51:33.118307 32504 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:51:33.119164 32504 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3b1a45d5e26847c7b421548884e0c029: Sending DeleteTablet for 3 replicas of tablet e41089b9b1a74a04941d01bb3bac18de
I20260811 16:51:33.119491 32698 tablet_service.cc:1514] Processing DeleteTablet for tablet e41089b9b1a74a04941d01bb3bac18de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:33 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:43420
I20260811 16:51:33.119585 432 tablet_service.cc:1514] Processing DeleteTablet for tablet e41089b9b1a74a04941d01bb3bac18de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:33 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:36270
I20260811 16:51:33.119832 832 tablet_replica.cc:330] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630: stopping tablet replica
I20260811 16:51:33.119904 658 tablet_service.cc:1514] Processing DeleteTablet for tablet e41089b9b1a74a04941d01bb3bac18de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:33 UTC) from {username='kudu', principal='kudu/127.2.55.190@KRBTEST.COM'} at 127.0.0.1:57572
I20260811 16:51:33.120121 833 tablet_replica.cc:330] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0: stopping tablet replica
I20260811 16:51:33.120173 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 32608
I20260811 16:51:33.120230 833 raft_consensus.cc:2229] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:51:33.120342 833 raft_consensus.cc:2258] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:51:33.120157 832 raft_consensus.cc:2229] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:51:33.123306 832 raft_consensus.cc:2258] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:51:33.126638 832 ts_tablet_manager.cc:1905] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:51:33.129351 832 ts_tablet_manager.cc:1918] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:51:33.129460 832 log.cc:1196] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/e41089b9b1a74a04941d01bb3bac18de
I20260811 16:51:33.129859 832 ts_tablet_manager.cc:1939] T e41089b9b1a74a04941d01bb3bac18de P b55b303a61114ea0abe113a6811d6630: Deleting consensus metadata
I20260811 16:51:33.130692 32481 catalog_manager.cc:4841] TS b55b303a61114ea0abe113a6811d6630 (127.2.55.130:43501): tablet e41089b9b1a74a04941d01bb3bac18de (table test-table [id=41f0301eb6ea461a98b8b146a701906f]) successfully deleted
I20260811 16:51:33.133562 833 ts_tablet_manager.cc:1905] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:51:33.135324 833 ts_tablet_manager.cc:1918] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:51:33.135447 833 log.cc:1196] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/e41089b9b1a74a04941d01bb3bac18de
I20260811 16:51:33.135710 833 ts_tablet_manager.cc:1939] T e41089b9b1a74a04941d01bb3bac18de P 3689f34794aa4009b6d16f78f7d1ece0: Deleting consensus metadata
I20260811 16:51:33.136196 32481 catalog_manager.cc:4841] TS 3689f34794aa4009b6d16f78f7d1ece0 (127.2.55.131:38679): tablet e41089b9b1a74a04941d01bb3bac18de (table test-table [id=41f0301eb6ea461a98b8b146a701906f]) successfully deleted
W20260811 16:51:33.140216 32481 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.55.129:45777 (error 108)
I20260811 16:51:33.140548 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 342
I20260811 16:51:33.145187 785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.140748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:45777 (local address 127.0.0.1:43446)
0811 16:51:33.145058 (+ 4310us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:33.145133 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:45777: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4271}
W20260811 16:51:33.145360 32481 catalog_manager.cc:4584] TS 6b331ca3968a4539a534b639bafe3cd2 (127.2.55.129:45777): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e41089b9b1a74a04941d01bb3bac18de: Network error: Client connection negotiation failed: client connection to 127.2.55.129:45777: connect: Connection refused (error 111)
I20260811 16:51:33.151336 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 550
I20260811 16:51:33.159391 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 32457
2026-08-11T16:51:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2402 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T16:51:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:33Z Disabled control of system clock
I20260811 16:51:33.197757 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:46539
--webserver_interface=127.2.55.190
--webserver_port=0
--builtin_ntp_servers=127.2.55.148:33603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:46539
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:51:33.281754 848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:33.282014 848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:33.282053 848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:33.283212 848 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:33.283283 848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:33.283308 848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:33.283329 848 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:33.283356 848 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:33.284758 848 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:33603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:46539
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:46539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:33.285111 848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:33.285434 848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:33.290724 857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:33.290778 862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:33.290771 848 server_base.cc:1034] running on GCE node
W20260811 16:51:33.290735 859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:33.291254 848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:33.291512 848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:33.292686 848 hybrid_clock.cc:648] HybridClock initialized: now 1786467093292662 us; error 37 us; skew 500 ppm
I20260811 16:51:33.294011 848 webserver.cc:460] Webserver started at http://127.2.55.190:40807/ using document root <none> and password file <none>
I20260811 16:51:33.294312 848 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:33.294389 848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:33.294544 848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:33.295646 848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "81a5cc27daa04952b7fc16a746e207a8"
format_stamp: "Formatted at 2026-08-11 16:51:33 on dist-test-slave-3h5h"
server_key: "9ffbf37679ffa6b7969aca45daa27ec8"
server_key_iv: "ce06554e2e3ffc38f4f1a46dff661465"
server_key_version: "encryptionkey@0"
I20260811 16:51:33.296124 848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "81a5cc27daa04952b7fc16a746e207a8"
format_stamp: "Formatted at 2026-08-11 16:51:33 on dist-test-slave-3h5h"
server_key: "9ffbf37679ffa6b7969aca45daa27ec8"
server_key_iv: "ce06554e2e3ffc38f4f1a46dff661465"
server_key_version: "encryptionkey@0"
I20260811 16:51:33.299721 848 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260811 16:51:33.300803 871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:33.301100 848 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:33.301209 848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "81a5cc27daa04952b7fc16a746e207a8"
format_stamp: "Formatted at 2026-08-11 16:51:33 on dist-test-slave-3h5h"
server_key: "9ffbf37679ffa6b7969aca45daa27ec8"
server_key_iv: "ce06554e2e3ffc38f4f1a46dff661465"
server_key_version: "encryptionkey@0"
I20260811 16:51:33.301285 848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:33.314047 848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:33.314428 848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:33.314606 848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:33.319545 848 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:46539
I20260811 16:51:33.319589 950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:46539 every 8 connection(s)
I20260811 16:51:33.320000 848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:33.321244 953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:33.322935 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 848
I20260811 16:51:33.323068 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:33.323300 2270 external_mini_cluster.cc:1428] Setting key b5d1d95c53d58c9dbcb0e06ff08854e2
I20260811 16:51:33.324230 953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8: Bootstrap starting.
I20260811 16:51:33.325009 953 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:33.325358 953 log.cc:824] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:33.326138 953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8: No bootstrap required, opened a new log
I20260811 16:51:33.328286 953 raft_consensus.cc:348] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81a5cc27daa04952b7fc16a746e207a8" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 46539 } }
I20260811 16:51:33.328483 953 raft_consensus.cc:374] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:33.328567 953 raft_consensus.cc:729] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81a5cc27daa04952b7fc16a746e207a8, State: Initialized, Role: FOLLOWER
I20260811 16:51:33.328728 953 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81a5cc27daa04952b7fc16a746e207a8" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 46539 } }
I20260811 16:51:33.328840 953 raft_consensus.cc:388] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:33.328912 953 raft_consensus.cc:482] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:33.328961 953 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:33.329216 958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.323902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35644 (local address 127.2.55.190:46539)
0811 16:51:33.324148 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:33.324155 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:33.324191 (+ 36us) server_negotiation.cc:407] Connection header received
0811 16:51:33.324698 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:33.324706 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:33.324773 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:33.325010 (+ 237us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:33.325237 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.326154 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.326950 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.327381 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.327518 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.328336 (+ 818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:33.328347 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:33.328347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:33.328590 (+ 243us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:33.328635 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:33.328653 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:33.328726 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:33.328880 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 16:51:33.328972 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":100,"threads_started":1}
I20260811 16:51:33.329754 953 raft_consensus.cc:504] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81a5cc27daa04952b7fc16a746e207a8" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 46539 } }
I20260811 16:51:33.329886 953 leader_election.cc:302] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 81a5cc27daa04952b7fc16a746e207a8; no voters:
I20260811 16:51:33.330118 953 leader_election.cc:288] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:33.330163 961 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:33.330317 961 raft_consensus.cc:686] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [term 1 LEADER]: Becoming Leader. State: Replica: 81a5cc27daa04952b7fc16a746e207a8, State: Running, Role: LEADER
I20260811 16:51:33.330412 953 sys_catalog.cc:564] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:33.330427 961 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81a5cc27daa04952b7fc16a746e207a8" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 46539 } }
I20260811 16:51:33.330785 961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81a5cc27daa04952b7fc16a746e207a8. Latest consensus state: current_term: 1 leader_uuid: "81a5cc27daa04952b7fc16a746e207a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81a5cc27daa04952b7fc16a746e207a8" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 46539 } } }
I20260811 16:51:33.330793 964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "81a5cc27daa04952b7fc16a746e207a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81a5cc27daa04952b7fc16a746e207a8" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 46539 } } }
I20260811 16:51:33.330883 961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:33.330899 964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:33.331576 973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:33.332193 973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:33.333976 973 catalog_manager.cc:1347] Generated new cluster ID: 6431027d8c504d30b4e233d81782be51
I20260811 16:51:33.334035 973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:33.361336 973 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:33.362131 973 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:33.369755 973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8: Generated new TSK 0
I20260811 16:51:33.369972 973 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:33.376972 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.129:0
--local_ip_for_outbound_sockets=127.2.55.129
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:46539
--builtin_ntp_servers=127.2.55.148:33603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:51:33.463606 992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:33.463850 992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:33.463889 992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:33.465200 992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:33.465265 992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:33.465324 992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.129
I20260811 16:51:33.466843 992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:33603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.55.129
--webserver_port=0
--tserver_master_addrs=127.2.55.190:46539
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.129
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:33.467137 992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:33.467459 992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:33.472729 999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:33.472718 998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:33.472970 992 server_base.cc:1034] running on GCE node
W20260811 16:51:33.472718 1006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:33.473340 992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:33.473624 992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:33.474846 992 hybrid_clock.cc:648] HybridClock initialized: now 1786467093474824 us; error 39 us; skew 500 ppm
I20260811 16:51:33.480037 992 webserver.cc:460] Webserver started at http://127.2.55.129:38981/ using document root <none> and password file <none>
I20260811 16:51:33.480324 992 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:33.480400 992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:33.480566 992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:33.481797 992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/data/instance:
uuid: "b92de4966c7841d9834763e8bfe32158"
format_stamp: "Formatted at 2026-08-11 16:51:33 on dist-test-slave-3h5h"
server_key: "76bf9d1d27b4dbef60c88ed573a39d12"
server_key_iv: "67c73e3963e95dea4b70189eccb265a1"
server_key_version: "encryptionkey@0"
I20260811 16:51:33.482175 992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance:
uuid: "b92de4966c7841d9834763e8bfe32158"
format_stamp: "Formatted at 2026-08-11 16:51:33 on dist-test-slave-3h5h"
server_key: "76bf9d1d27b4dbef60c88ed573a39d12"
server_key_iv: "67c73e3963e95dea4b70189eccb265a1"
server_key_version: "encryptionkey@0"
I20260811 16:51:33.483716 992 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:51:33.484628 1012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:33.484827 992 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:51:33.484997 992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/wal
uuid: "b92de4966c7841d9834763e8bfe32158"
format_stamp: "Formatted at 2026-08-11 16:51:33 on dist-test-slave-3h5h"
server_key: "76bf9d1d27b4dbef60c88ed573a39d12"
server_key_iv: "67c73e3963e95dea4b70189eccb265a1"
server_key_version: "encryptionkey@0"
I20260811 16:51:33.485092 992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:33.493568 992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:33.493884 992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:33.494048 992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:33.494280 992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:33.494644 992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:33.494705 992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:33.494751 992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:33.494799 992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:33.501360 992 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.129:42115
I20260811 16:51:33.501397 1183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.129:42115 every 8 connection(s)
I20260811 16:51:33.501770 992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/data/info.pb
I20260811 16:51:33.503252 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 992
I20260811 16:51:33.503435 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-0/wal/instance
I20260811 16:51:33.503710 2270 external_mini_cluster.cc:1428] Setting key 5c95b7370d9ef1c54ae2a4ff5989b738
I20260811 16:51:33.505362 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.130:0
--local_ip_for_outbound_sockets=127.2.55.130
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:46539
--builtin_ntp_servers=127.2.55.148:33603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 16:51:33.507812 958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.502597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.129:53833 (local address 127.2.55.190:46539)
0811 16:51:33.502648 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:33.502650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:33.502907 (+ 257us) server_negotiation.cc:407] Connection header received
0811 16:51:33.503396 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:33.503397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:33.503417 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:33.503479 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:33.504455 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.505133 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.506239 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.506538 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.506617 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.507511 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:33.507513 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:33.507513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:33.507518 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:33.507542 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:33.507546 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:33.507606 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:33.507703 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 16:51:33.507731 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:51:33.508059 1187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.502540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:46539 (local address 127.2.55.129:53833)
0811 16:51:33.502740 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:33.502784 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:33.503281 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:33.503562 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:33.503566 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:33.503577 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:33.504312 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.504320 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.505255 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.505256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.506123 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.506125 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.506631 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.506632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.506747 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.507350 (+ 603us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:51:33.507350 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:33.507380 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:51:33.507403 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:33.507607 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:33.507615 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:33.507618 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:51:33.507685 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 16:51:33.507797 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":103,"threads_started":1}
I20260811 16:51:33.508579 1184 heartbeater.cc:347] Connected to a master server at 127.2.55.190:46539
I20260811 16:51:33.508711 1184 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:33.508946 1184 heartbeater.cc:511] Master 127.2.55.190:46539 requested a full tablet report, sending...
I20260811 16:51:33.509553 895 ts_manager.cc:194] Registered new tserver with Master: b92de4966c7841d9834763e8bfe32158 (127.2.55.129:42115)
I20260811 16:51:33.510582 895 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.55.129:53833
W20260811 16:51:33.591249 1188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:33.591464 1188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:33.591488 1188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:33.592610 1188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:33.592648 1188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:33.592671 1188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.130
I20260811 16:51:33.594060 1188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:33603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.55.130
--webserver_port=0
--tserver_master_addrs=127.2.55.190:46539
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.130
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:33.594266 1188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:33.594521 1188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:33.599644 1195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:33.599627 1197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:33.599627 1194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:33.599977 1188 server_base.cc:1034] running on GCE node
I20260811 16:51:33.600224 1188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:33.600471 1188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:33.601627 1188 hybrid_clock.cc:648] HybridClock initialized: now 1786467093601617 us; error 27 us; skew 500 ppm
I20260811 16:51:33.602924 1188 webserver.cc:460] Webserver started at http://127.2.55.130:34027/ using document root <none> and password file <none>
I20260811 16:51:33.603191 1188 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:33.603263 1188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:33.603423 1188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:33.604615 1188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/data/instance:
uuid: "8e220befd80f41d89732a69db4e1a424"
format_stamp: "Formatted at 2026-08-11 16:51:33 on dist-test-slave-3h5h"
server_key: "a8be3a74eab7e3a58ab1e5f9b2e7343f"
server_key_iv: "104719ef52264ac801e554f2f831abe8"
server_key_version: "encryptionkey@0"
I20260811 16:51:33.605026 1188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance:
uuid: "8e220befd80f41d89732a69db4e1a424"
format_stamp: "Formatted at 2026-08-11 16:51:33 on dist-test-slave-3h5h"
server_key: "a8be3a74eab7e3a58ab1e5f9b2e7343f"
server_key_iv: "104719ef52264ac801e554f2f831abe8"
server_key_version: "encryptionkey@0"
I20260811 16:51:33.606451 1188 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:51:33.607216 1210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:33.607384 1188 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:51:33.607494 1188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/wal
uuid: "8e220befd80f41d89732a69db4e1a424"
format_stamp: "Formatted at 2026-08-11 16:51:33 on dist-test-slave-3h5h"
server_key: "a8be3a74eab7e3a58ab1e5f9b2e7343f"
server_key_iv: "104719ef52264ac801e554f2f831abe8"
server_key_version: "encryptionkey@0"
I20260811 16:51:33.607569 1188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:33.625531 1188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:33.625865 1188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:33.626027 1188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:33.626273 1188 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:33.626748 1188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:33.626813 1188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:33.626853 1188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:33.626875 1188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:33.634847 1188 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.130:34433
I20260811 16:51:33.634922 1401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.130:34433 every 8 connection(s)
I20260811 16:51:33.635245 1188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/data/info.pb
I20260811 16:51:33.642002 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 1188
I20260811 16:51:33.642138 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/wal/instance
I20260811 16:51:33.642386 2270 external_mini_cluster.cc:1428] Setting key 8294105ec09dc98fa09bcfd398cd1e15
I20260811 16:51:33.643604 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.55.131:0
--local_ip_for_outbound_sockets=127.2.55.131
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:46539
--builtin_ntp_servers=127.2.55.148:33603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 16:51:33.644716 958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.639113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:53403 (local address 127.2.55.190:46539)
0811 16:51:33.639207 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:33.639209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:33.639618 (+ 409us) server_negotiation.cc:407] Connection header received
0811 16:51:33.640435 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:33.640437 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:33.640452 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:33.640539 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:33.641455 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.641987 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.643241 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.643450 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.643483 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.644426 (+ 943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:33.644428 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:33.644428 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:33.644433 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:33.644448 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:33.644452 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:33.644504 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:33.644594 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 16:51:33.644622 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 16:51:33.644968 1407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.639113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:46539 (local address 127.2.55.130:53403)
0811 16:51:33.639472 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:33.639524 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:33.640306 (+ 782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:33.640722 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:33.640727 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:33.640739 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:33.641344 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.641348 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.642084 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.642085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.643135 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.643138 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.643560 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.643560 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.643680 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.644263 (+ 583us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:51:33.644264 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:33.644293 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:51:33.644316 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:33.644516 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:33.644521 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:33.644524 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:51:33.644604 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 16:51:33.644709 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":81,"threads_started":1}
I20260811 16:51:33.645416 1403 heartbeater.cc:347] Connected to a master server at 127.2.55.190:46539
I20260811 16:51:33.645532 1403 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:33.645753 1403 heartbeater.cc:511] Master 127.2.55.190:46539 requested a full tablet report, sending...
I20260811 16:51:33.646152 895 ts_manager.cc:194] Registered new tserver with Master: 8e220befd80f41d89732a69db4e1a424 (127.2.55.130:34433)
I20260811 16:51:33.646564 895 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.55.130:53403
W20260811 16:51:33.744335 1408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:33.744609 1408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:33.744650 1408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:33.745919 1408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:33.745996 1408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:33.746039 1408 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.55.131
I20260811 16:51:33.747460 1408 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:33603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.55.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.55.131
--webserver_port=0
--tserver_master_addrs=127.2.55.190:46539
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.55.131
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:33.747757 1408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:33.748112 1408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:33.753647 1419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:33.753648 1416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:33.753633 1414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:33.754086 1408 server_base.cc:1034] running on GCE node
I20260811 16:51:33.754320 1408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:33.754581 1408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:33.755780 1408 hybrid_clock.cc:648] HybridClock initialized: now 1786467093755781 us; error 47 us; skew 500 ppm
I20260811 16:51:33.757400 1408 webserver.cc:460] Webserver started at http://127.2.55.131:45081/ using document root <none> and password file <none>
I20260811 16:51:33.757675 1408 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:33.757750 1408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:33.757913 1408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:33.759063 1408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/data/instance:
uuid: "db676774683a49a6bd2c09f5d1fc8dda"
format_stamp: "Formatted at 2026-08-11 16:51:33 on dist-test-slave-3h5h"
server_key: "104474c2b3b3279522b810b732e919df"
server_key_iv: "fcd43aef2587e8282c93380e7d7e5fa5"
server_key_version: "encryptionkey@0"
I20260811 16:51:33.759454 1408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance:
uuid: "db676774683a49a6bd2c09f5d1fc8dda"
format_stamp: "Formatted at 2026-08-11 16:51:33 on dist-test-slave-3h5h"
server_key: "104474c2b3b3279522b810b732e919df"
server_key_iv: "fcd43aef2587e8282c93380e7d7e5fa5"
server_key_version: "encryptionkey@0"
I20260811 16:51:33.760947 1408 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260811 16:51:33.761874 1430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:33.762177 1408 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:33.762300 1408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/wal
uuid: "db676774683a49a6bd2c09f5d1fc8dda"
format_stamp: "Formatted at 2026-08-11 16:51:33 on dist-test-slave-3h5h"
server_key: "104474c2b3b3279522b810b732e919df"
server_key_iv: "fcd43aef2587e8282c93380e7d7e5fa5"
server_key_version: "encryptionkey@0"
I20260811 16:51:33.762383 1408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:33.785660 1408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:33.786067 1408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:33.786234 1408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:33.786513 1408 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:51:33.786871 1408 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:51:33.786931 1408 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:33.786974 1408 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:51:33.786999 1408 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:33.793151 1408 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.131:46845
I20260811 16:51:33.793227 1603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.131:46845 every 8 connection(s)
I20260811 16:51:33.793591 1408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/data/info.pb
I20260811 16:51:33.798998 958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.794428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.131:34103 (local address 127.2.55.190:46539)
0811 16:51:33.794524 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:33.794526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:33.794728 (+ 202us) server_negotiation.cc:407] Connection header received
0811 16:51:33.795206 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:33.795207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:33.795217 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:33.795274 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:33.795976 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.796611 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.797592 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.797798 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.797858 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.798724 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:33.798725 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:33.798726 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:33.798730 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:33.798745 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:33.798749 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:33.798805 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:33.798908 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 16:51:33.798934 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 16:51:33.799166 1608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.794384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:46539 (local address 127.2.55.131:34103)
0811 16:51:33.794587 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:33.794623 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:33.795122 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:33.795325 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:33.795328 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:33.795336 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:51:33.795844 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.795849 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.796717 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.796718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.797508 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.797510 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.797882 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.797883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.797998 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.798588 (+ 590us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:51:33.798589 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:51:33.798619 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:51:33.798643 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:51:33.798811 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:51:33.798816 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:51:33.798818 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:51:33.798873 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 16:51:33.798960 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":102,"threads_started":1}
I20260811 16:51:33.799692 1604 heartbeater.cc:347] Connected to a master server at 127.2.55.190:46539
I20260811 16:51:33.799783 1604 heartbeater.cc:464] Registering TS with master...
I20260811 16:51:33.799942 1604 heartbeater.cc:511] Master 127.2.55.190:46539 requested a full tablet report, sending...
I20260811 16:51:33.800330 895 ts_manager.cc:194] Registered new tserver with Master: db676774683a49a6bd2c09f5d1fc8dda (127.2.55.131:46845)
I20260811 16:51:33.800709 895 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.55.131:34103
I20260811 16:51:33.802093 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 1408
I20260811 16:51:33.802218 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/wal/instance
I20260811 16:51:33.802409 2270 external_mini_cluster.cc:1428] Setting key 3a6e5ee899990dbf08923a9d18c333f5
I20260811 16:51:33.803346 2270 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:51:33.807862 958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.804905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35658 (local address 127.2.55.190:46539)
0811 16:51:33.804958 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:33.804960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:33.805116 (+ 156us) server_negotiation.cc:407] Connection header received
0811 16:51:33.805186 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:33.805187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:33.805197 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:33.805270 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:33.805464 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.805956 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.806685 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.806883 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.806945 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.807644 (+ 699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:33.807645 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:33.807645 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:33.807650 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:33.807663 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:33.807667 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:33.807714 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:33.807780 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 16:51:33.807801 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:51:33.809422 895 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35658:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:51:33.811213 895 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:51:33.817801 1619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.813524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.130:34433 (local address 127.0.0.1:42550)
0811 16:51:33.813649 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:33.813693 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:33.813774 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:33.814147 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:33.814150 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:33.814152 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:33.814225 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.814227 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.815226 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.815227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.816449 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.816451 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.817458 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.817459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.817552 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.817572 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 16:51:33.817640 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 16:51:33.817715 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":77,"threads_started":1}
I20260811 16:51:33.818019 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.813729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49150 (local address 127.2.55.131:46845)
0811 16:51:33.814248 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:33.814252 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:33.814262 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:51:33.814300 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:33.814302 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:33.814316 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:33.814555 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:33.814617 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.815707 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.816942 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.817494 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.817602 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.817694 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:33.817763 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 16:51:33.817802 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":109,"threads_started":1}
I20260811 16:51:33.818085 1621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.813620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42550 (local address 127.2.55.130:34433)
0811 16:51:33.813986 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:33.813991 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:33.814002 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:51:33.814045 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:33.814047 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:33.814065 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:33.814144 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:33.814315 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.815123 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.816561 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.817358 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.817436 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.817536 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:33.817941 (+ 405us) server_negotiation.cc:299] Negotiation successful
0811 16:51:33.817993 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":112,"threads_started":1}
I20260811 16:51:33.818329 1620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.813535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:46845 (local address 127.0.0.1:49150)
0811 16:51:33.813830 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:33.813841 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:33.813895 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:33.814417 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:33.814418 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:33.814420 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:33.814475 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.814478 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.815798 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.815799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.816824 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.816826 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.817614 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.817615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.817681 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.817685 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:51:33.817747 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 16:51:33.817785 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":5,"thread_start_us":62,"threads_started":1}
I20260811 16:51:33.819029 1498 tablet_service.cc:1467] Processing CreateTablet for tablet 87cd9326075b47b094d7e38a7ce08827 (DEFAULT_TABLE table=test-table [id=7a8499575f97438cb2ba58f48f2a4c25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:33.818902 1293 tablet_service.cc:1467] Processing CreateTablet for tablet 87cd9326075b47b094d7e38a7ce08827 (DEFAULT_TABLE table=test-table [id=7a8499575f97438cb2ba58f48f2a4c25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:33.819288 1624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.814011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52902 (local address 127.2.55.129:42115)
0811 16:51:33.814189 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:33.814194 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:33.814206 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:51:33.814251 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:33.814253 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:33.814270 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:33.814353 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:33.814562 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.815705 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.818092 (+ 2387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.818888 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.818985 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.819087 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:33.819161 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 16:51:33.819203 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":98,"threads_started":1}
I20260811 16:51:33.819453 1498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87cd9326075b47b094d7e38a7ce08827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:33.819511 1293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87cd9326075b47b094d7e38a7ce08827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:33.819526 1623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.813766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:42115 (local address 127.0.0.1:52902)
0811 16:51:33.813907 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:33.813918 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:33.813964 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:33.814421 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:33.814421 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:33.814423 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:33.814476 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.814478 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.816942 (+ 2464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.816943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.817985 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.817988 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.818999 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.819000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.819068 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.819073 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:51:33.819145 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 16:51:33.819199 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":2,"thread_start_us":92,"threads_started":1}
I20260811 16:51:33.820360 1088 tablet_service.cc:1467] Processing CreateTablet for tablet 87cd9326075b47b094d7e38a7ce08827 (DEFAULT_TABLE table=test-table [id=7a8499575f97438cb2ba58f48f2a4c25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:51:33.820742 1088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87cd9326075b47b094d7e38a7ce08827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:33.822515 1626 tablet_bootstrap.cc:492] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda: Bootstrap starting.
I20260811 16:51:33.823199 1628 tablet_bootstrap.cc:492] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424: Bootstrap starting.
I20260811 16:51:33.823374 1626 tablet_bootstrap.cc:654] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:33.823764 1626 log.cc:824] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:33.824020 1628 tablet_bootstrap.cc:654] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:33.824349 1628 log.cc:824] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:33.824592 1626 tablet_bootstrap.cc:492] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda: No bootstrap required, opened a new log
I20260811 16:51:33.824666 1626 ts_tablet_manager.cc:1397] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:51:33.825083 1631 tablet_bootstrap.cc:492] T 87cd9326075b47b094d7e38a7ce08827 P b92de4966c7841d9834763e8bfe32158: Bootstrap starting.
I20260811 16:51:33.825242 1628 tablet_bootstrap.cc:492] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424: No bootstrap required, opened a new log
I20260811 16:51:33.825325 1628 ts_tablet_manager.cc:1397] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:51:33.825706 1631 tablet_bootstrap.cc:654] T 87cd9326075b47b094d7e38a7ce08827 P b92de4966c7841d9834763e8bfe32158: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:33.826052 1631 log.cc:824] T 87cd9326075b47b094d7e38a7ce08827 P b92de4966c7841d9834763e8bfe32158: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:33.826749 1631 tablet_bootstrap.cc:492] T 87cd9326075b47b094d7e38a7ce08827 P b92de4966c7841d9834763e8bfe32158: No bootstrap required, opened a new log
I20260811 16:51:33.826833 1631 ts_tablet_manager.cc:1397] T 87cd9326075b47b094d7e38a7ce08827 P b92de4966c7841d9834763e8bfe32158: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 16:51:33.827550 1626 raft_consensus.cc:348] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db676774683a49a6bd2c09f5d1fc8dda" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46845 } } peers { permanent_uuid: "8e220befd80f41d89732a69db4e1a424" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34433 } } peers { permanent_uuid: "b92de4966c7841d9834763e8bfe32158" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42115 } }
I20260811 16:51:33.827732 1626 raft_consensus.cc:374] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:33.827767 1626 raft_consensus.cc:729] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db676774683a49a6bd2c09f5d1fc8dda, State: Initialized, Role: FOLLOWER
I20260811 16:51:33.827916 1626 consensus_queue.cc:260] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db676774683a49a6bd2c09f5d1fc8dda" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46845 } } peers { permanent_uuid: "8e220befd80f41d89732a69db4e1a424" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34433 } } peers { permanent_uuid: "b92de4966c7841d9834763e8bfe32158" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42115 } }
I20260811 16:51:33.827939 1628 raft_consensus.cc:348] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db676774683a49a6bd2c09f5d1fc8dda" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46845 } } peers { permanent_uuid: "8e220befd80f41d89732a69db4e1a424" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34433 } } peers { permanent_uuid: "b92de4966c7841d9834763e8bfe32158" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42115 } }
I20260811 16:51:33.828084 1628 raft_consensus.cc:374] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:33.828123 1628 raft_consensus.cc:729] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e220befd80f41d89732a69db4e1a424, State: Initialized, Role: FOLLOWER
I20260811 16:51:33.828209 1626 ts_tablet_manager.cc:1428] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260811 16:51:33.828255 1628 consensus_queue.cc:260] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db676774683a49a6bd2c09f5d1fc8dda" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46845 } } peers { permanent_uuid: "8e220befd80f41d89732a69db4e1a424" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34433 } } peers { permanent_uuid: "b92de4966c7841d9834763e8bfe32158" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42115 } }
I20260811 16:51:33.828320 1604 heartbeater.cc:503] Master 127.2.55.190:46539 was elected leader, sending a full tablet report...
I20260811 16:51:33.828526 1628 ts_tablet_manager.cc:1428] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 16:51:33.828583 1403 heartbeater.cc:503] Master 127.2.55.190:46539 was elected leader, sending a full tablet report...
I20260811 16:51:33.829356 1631 raft_consensus.cc:348] T 87cd9326075b47b094d7e38a7ce08827 P b92de4966c7841d9834763e8bfe32158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db676774683a49a6bd2c09f5d1fc8dda" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46845 } } peers { permanent_uuid: "8e220befd80f41d89732a69db4e1a424" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34433 } } peers { permanent_uuid: "b92de4966c7841d9834763e8bfe32158" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42115 } }
I20260811 16:51:33.829519 1631 raft_consensus.cc:374] T 87cd9326075b47b094d7e38a7ce08827 P b92de4966c7841d9834763e8bfe32158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:33.829568 1631 raft_consensus.cc:729] T 87cd9326075b47b094d7e38a7ce08827 P b92de4966c7841d9834763e8bfe32158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b92de4966c7841d9834763e8bfe32158, State: Initialized, Role: FOLLOWER
I20260811 16:51:33.829686 1631 consensus_queue.cc:260] T 87cd9326075b47b094d7e38a7ce08827 P b92de4966c7841d9834763e8bfe32158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db676774683a49a6bd2c09f5d1fc8dda" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46845 } } peers { permanent_uuid: "8e220befd80f41d89732a69db4e1a424" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34433 } } peers { permanent_uuid: "b92de4966c7841d9834763e8bfe32158" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42115 } }
I20260811 16:51:33.829936 1631 ts_tablet_manager.cc:1428] T 87cd9326075b47b094d7e38a7ce08827 P b92de4966c7841d9834763e8bfe32158: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:51:33.830022 1184 heartbeater.cc:503] Master 127.2.55.190:46539 was elected leader, sending a full tablet report...
W20260811 16:51:33.887724 1404 tablet.cc:2369] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:51:33.910666 1644 raft_consensus.cc:482] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:51:33.910792 1644 raft_consensus.cc:504] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db676774683a49a6bd2c09f5d1fc8dda" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46845 } } peers { permanent_uuid: "8e220befd80f41d89732a69db4e1a424" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34433 } } peers { permanent_uuid: "b92de4966c7841d9834763e8bfe32158" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42115 } }
I20260811 16:51:33.911123 1644 leader_election.cc:288] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers db676774683a49a6bd2c09f5d1fc8dda (127.2.55.131:46845), b92de4966c7841d9834763e8bfe32158 (127.2.55.129:42115)
I20260811 16:51:33.914117 1624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.911433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:45351 (local address 127.2.55.129:42115)
0811 16:51:33.911507 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:33.911509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:33.911518 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:51:33.911551 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:33.911551 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:33.911563 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:33.911642 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:33.911811 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.912321 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.913346 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.913740 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.913838 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.913848 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:33.914004 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 16:51:33.914047 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:51:33.914119 1407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.911324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:42115 (local address 127.2.55.130:45351)
0811 16:51:33.911393 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:33.911408 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:33.911476 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:33.911647 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:33.911648 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:33.911649 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:33.911729 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.911731 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.912409 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.912410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.913253 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.913256 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.913838 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.913839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.913916 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.913919 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:51:33.913996 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 16:51:33.914040 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 16:51:33.914484 1112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87cd9326075b47b094d7e38a7ce08827" candidate_uuid: "8e220befd80f41d89732a69db4e1a424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b92de4966c7841d9834763e8bfe32158" is_pre_election: true
I20260811 16:51:33.914644 1648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.911324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.131:46845 (local address 127.2.55.130:32971)
0811 16:51:33.911603 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:33.911615 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:51:33.911686 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:51:33.911824 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:51:33.911825 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:51:33.911827 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:51:33.911919 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.911921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.912715 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.912716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.913625 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:51:33.913627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.914358 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.914360 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:51:33.914430 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.914434 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:51:33.914508 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 16:51:33.914553 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":72,"thread_start_us":142,"threads_started":1}
I20260811 16:51:33.914642 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.911450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.55.130:32971 (local address 127.2.55.131:46845)
0811 16:51:33.911503 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:33.911506 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:33.911670 (+ 164us) server_negotiation.cc:407] Connection header received
0811 16:51:33.911753 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:33.911754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:33.911765 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:33.911823 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:51:33.912101 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.912616 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.913759 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.914220 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.914306 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.914315 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:33.914530 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 16:51:33.914574 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:51:33.914693 1112 raft_consensus.cc:2454] T 87cd9326075b47b094d7e38a7ce08827 P b92de4966c7841d9834763e8bfe32158 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e220befd80f41d89732a69db4e1a424 in term 0.
I20260811 16:51:33.914956 1212 leader_election.cc:302] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e220befd80f41d89732a69db4e1a424, b92de4966c7841d9834763e8bfe32158; no voters:
I20260811 16:51:33.914950 1537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87cd9326075b47b094d7e38a7ce08827" candidate_uuid: "8e220befd80f41d89732a69db4e1a424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db676774683a49a6bd2c09f5d1fc8dda" is_pre_election: true
I20260811 16:51:33.915104 1537 raft_consensus.cc:2454] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e220befd80f41d89732a69db4e1a424 in term 0.
I20260811 16:51:33.915126 1644 raft_consensus.cc:2781] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:51:33.915210 1644 raft_consensus.cc:482] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:51:33.915246 1644 raft_consensus.cc:3037] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:33.916074 1644 raft_consensus.cc:504] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db676774683a49a6bd2c09f5d1fc8dda" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46845 } } peers { permanent_uuid: "8e220befd80f41d89732a69db4e1a424" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34433 } } peers { permanent_uuid: "b92de4966c7841d9834763e8bfe32158" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42115 } }
I20260811 16:51:33.916229 1644 leader_election.cc:288] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [CANDIDATE]: Term 1 election: Requested vote from peers db676774683a49a6bd2c09f5d1fc8dda (127.2.55.131:46845), b92de4966c7841d9834763e8bfe32158 (127.2.55.129:42115)
I20260811 16:51:33.916375 1112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87cd9326075b47b094d7e38a7ce08827" candidate_uuid: "8e220befd80f41d89732a69db4e1a424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b92de4966c7841d9834763e8bfe32158"
I20260811 16:51:33.916419 1537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87cd9326075b47b094d7e38a7ce08827" candidate_uuid: "8e220befd80f41d89732a69db4e1a424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db676774683a49a6bd2c09f5d1fc8dda"
I20260811 16:51:33.916465 1112 raft_consensus.cc:3037] T 87cd9326075b47b094d7e38a7ce08827 P b92de4966c7841d9834763e8bfe32158 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:33.916500 1537 raft_consensus.cc:3037] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:33.917454 1112 raft_consensus.cc:2454] T 87cd9326075b47b094d7e38a7ce08827 P b92de4966c7841d9834763e8bfe32158 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e220befd80f41d89732a69db4e1a424 in term 1.
I20260811 16:51:33.917454 1537 raft_consensus.cc:2454] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e220befd80f41d89732a69db4e1a424 in term 1.
I20260811 16:51:33.917625 1216 leader_election.cc:302] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e220befd80f41d89732a69db4e1a424, db676774683a49a6bd2c09f5d1fc8dda; no voters:
I20260811 16:51:33.917732 1644 raft_consensus.cc:2781] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:33.917932 1644 raft_consensus.cc:686] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [term 1 LEADER]: Becoming Leader. State: Replica: 8e220befd80f41d89732a69db4e1a424, State: Running, Role: LEADER
I20260811 16:51:33.918020 1644 consensus_queue.cc:237] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db676774683a49a6bd2c09f5d1fc8dda" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46845 } } peers { permanent_uuid: "8e220befd80f41d89732a69db4e1a424" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34433 } } peers { permanent_uuid: "b92de4966c7841d9834763e8bfe32158" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42115 } }
I20260811 16:51:33.918958 893 catalog_manager.cc:5495] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e220befd80f41d89732a69db4e1a424 (127.2.55.130). New cstate: current_term: 1 leader_uuid: "8e220befd80f41d89732a69db4e1a424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db676774683a49a6bd2c09f5d1fc8dda" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e220befd80f41d89732a69db4e1a424" member_type: VOTER last_known_addr { host: "127.2.55.130" port: 34433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b92de4966c7841d9834763e8bfe32158" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42115 } health_report { overall_health: UNKNOWN } } }
I20260811 16:51:33.938506 1621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.935728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42554 (local address 127.2.55.130:34433)
0811 16:51:33.935802 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:33.935804 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:33.935813 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:51:33.935859 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:33.935860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:33.935883 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:33.936040 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:51:33.936126 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.936676 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.937595 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:33.937818 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:33.937908 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:33.938117 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:51:33.938226 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:51:33.938333 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:33.938354 (+ 21us) server_negotiation.cc:299] Negotiation successful
0811 16:51:33.938376 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 16:51:33.940630 1112 raft_consensus.cc:1261] T 87cd9326075b47b094d7e38a7ce08827 P b92de4966c7841d9834763e8bfe32158 [term 1 FOLLOWER]: Refusing update from remote peer 8e220befd80f41d89732a69db4e1a424: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:51:33.940630 1537 raft_consensus.cc:1261] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda [term 1 FOLLOWER]: Refusing update from remote peer 8e220befd80f41d89732a69db4e1a424: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:51:33.941080 1651 consensus_queue.cc:1035] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b92de4966c7841d9834763e8bfe32158" member_type: VOTER last_known_addr { host: "127.2.55.129" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:51:33.941247 1644 consensus_queue.cc:1035] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db676774683a49a6bd2c09f5d1fc8dda" member_type: VOTER last_known_addr { host: "127.2.55.131" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:51:33.943657 1657 mvcc.cc:205] Tried to move back new op lower bound from 7317369216777269248 to 7317369216688816128. Current Snapshot: MvccSnapshot[applied={T|T < 7317369216777269248}]
I20260811 16:51:33.943971 1660 mvcc.cc:205] Tried to move back new op lower bound from 7317369216777269248 to 7317369216688816128. Current Snapshot: MvccSnapshot[applied={T|T < 7317369216777269248}]
I20260811 16:51:33.947341 893 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35658:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:51:33.947445 893 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35658:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:51:33.948683 893 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 81a5cc27daa04952b7fc16a746e207a8: Sending DeleteTablet for 3 replicas of tablet 87cd9326075b47b094d7e38a7ce08827
I20260811 16:51:33.949074 1293 tablet_service.cc:1514] Processing DeleteTablet for tablet 87cd9326075b47b094d7e38a7ce08827 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:33 UTC) from {username='slave'} at 127.0.0.1:42550
I20260811 16:51:33.949047 1498 tablet_service.cc:1514] Processing DeleteTablet for tablet 87cd9326075b47b094d7e38a7ce08827 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:33 UTC) from {username='slave'} at 127.0.0.1:49150
I20260811 16:51:33.949131 1088 tablet_service.cc:1514] Processing DeleteTablet for tablet 87cd9326075b47b094d7e38a7ce08827 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:51:33 UTC) from {username='slave'} at 127.0.0.1:52902
I20260811 16:51:33.949321 1682 tablet_replica.cc:330] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda: stopping tablet replica
I20260811 16:51:33.949435 1682 raft_consensus.cc:2229] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:51:33.949443 1684 tablet_replica.cc:330] T 87cd9326075b47b094d7e38a7ce08827 P b92de4966c7841d9834763e8bfe32158: stopping tablet replica
I20260811 16:51:33.949553 1682 raft_consensus.cc:2258] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:51:33.949594 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 992
I20260811 16:51:33.949731 1680 tablet_replica.cc:330] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424: stopping tablet replica
I20260811 16:51:33.949824 1680 raft_consensus.cc:2229] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:51:33.949941 1680 raft_consensus.cc:2258] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:51:33.950557 1682 ts_tablet_manager.cc:1905] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:51:33.952926 1682 ts_tablet_manager.cc:1918] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:51:33.953022 1682 log.cc:1196] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-2/wal/wals/87cd9326075b47b094d7e38a7ce08827
I20260811 16:51:33.953366 1682 ts_tablet_manager.cc:1939] T 87cd9326075b47b094d7e38a7ce08827 P db676774683a49a6bd2c09f5d1fc8dda: Deleting consensus metadata
I20260811 16:51:33.953918 874 catalog_manager.cc:4841] TS db676774683a49a6bd2c09f5d1fc8dda (127.2.55.131:46845): tablet 87cd9326075b47b094d7e38a7ce08827 (table test-table [id=7a8499575f97438cb2ba58f48f2a4c25]) successfully deleted
I20260811 16:51:33.957422 1680 ts_tablet_manager.cc:1905] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:51:33.960345 1680 ts_tablet_manager.cc:1918] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:51:33.960534 1680 log.cc:1196] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424: Deleting WAL directory at /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466835675343-2270-0/minicluster-data/ts-1/wal/wals/87cd9326075b47b094d7e38a7ce08827
I20260811 16:51:33.960963 1680 ts_tablet_manager.cc:1939] T 87cd9326075b47b094d7e38a7ce08827 P 8e220befd80f41d89732a69db4e1a424: Deleting consensus metadata
I20260811 16:51:33.961556 873 catalog_manager.cc:4841] TS 8e220befd80f41d89732a69db4e1a424 (127.2.55.130:34433): tablet 87cd9326075b47b094d7e38a7ce08827 (table test-table [id=7a8499575f97438cb2ba58f48f2a4c25]) successfully deleted
W20260811 16:51:33.966729 873 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.55.129:42115 (error 108)
I20260811 16:51:33.966892 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 1188
I20260811 16:51:33.968024 1620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:33.967846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.129:42115 (local address 127.0.0.1:52910)
0811 16:51:33.967929 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0811 16:51:33.967980 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.129:42115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 16:51:33.968147 873 catalog_manager.cc:4584] TS b92de4966c7841d9834763e8bfe32158 (127.2.55.129:42115): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 87cd9326075b47b094d7e38a7ce08827: Network error: Client connection negotiation failed: client connection to 127.2.55.129:42115: connect: Connection refused (error 111)
I20260811 16:51:33.978870 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 1408
I20260811 16:51:33.993709 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 848
2026-08-11T16:51:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (832 ms)
[----------] 6 tests from EncryptionPolicyTest (10011 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:34 dist-test-slave-3h5h krb5kdc[1690](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:34 dist-test-slave-3h5h krb5kdc[1690](info): set up 2 sockets
Aug 11 16:51:34 dist-test-slave-3h5h krb5kdc[1690](info): commencing operation
krb5kdc: starting...
W20260811 16:51:35.276144 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:35 dist-test-slave-3h5h krb5kdc[1690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:51:35.419472 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37767
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37767
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:35.504733 1710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:35.505002 1710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:35.505026 1710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:35.506218 1710 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:35.506266 1710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:35.506281 1710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:35.506294 1710 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:35.506305 1710 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:35.507831 1710 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37767
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:35.508076 1710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:35.508350 1710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:35.513326 1720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:35.513475 1710 server_base.cc:1034] running on GCE node
W20260811 16:51:35.513355 1722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:35.513330 1725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:35.513839 1710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:35.514091 1710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:35.515272 1710 hybrid_clock.cc:648] HybridClock initialized: now 1786467095515249 us; error 39 us; skew 500 ppm
Aug 11 16:51:35 dist-test-slave-3h5h krb5kdc[1690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467095, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:35.517983 1710 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:51:35.518474 1710 webserver.cc:460] Webserver started at http://127.0.0.1:39943/ using document root <none> and password file <none>
I20260811 16:51:35.518744 1710 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:35.518816 1710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:35.518968 1710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:35.520078 1710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "c584a559205f45debb3ec78130c72cff"
format_stamp: "Formatted at 2026-08-11 16:51:35 on dist-test-slave-3h5h"
server_key: "da55380fbc43682be74b3503fc0cb662"
server_key_iv: "2aaac7c8ad53f11cc67bd47c536d60f7"
server_key_version: "encryptionkey@0"
I20260811 16:51:35.520453 1710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "c584a559205f45debb3ec78130c72cff"
format_stamp: "Formatted at 2026-08-11 16:51:35 on dist-test-slave-3h5h"
server_key: "da55380fbc43682be74b3503fc0cb662"
server_key_iv: "2aaac7c8ad53f11cc67bd47c536d60f7"
server_key_version: "encryptionkey@0"
I20260811 16:51:35.521930 1710 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:51:35.522765 1737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:35.522980 1710 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:51:35.523092 1710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "c584a559205f45debb3ec78130c72cff"
format_stamp: "Formatted at 2026-08-11 16:51:35 on dist-test-slave-3h5h"
server_key: "da55380fbc43682be74b3503fc0cb662"
server_key_iv: "2aaac7c8ad53f11cc67bd47c536d60f7"
server_key_version: "encryptionkey@0"
I20260811 16:51:35.523170 1710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:35.538235 1710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:35.540223 1710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:35.540392 1710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:35.544847 1710 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37767
I20260811 16:51:35.544955 1833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37767 every 8 connection(s)
I20260811 16:51:35.545377 1710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:35.546458 1834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:35.548810 1834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff: Bootstrap starting.
I20260811 16:51:35.549398 1834 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:35.549652 1834 log.cc:824] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:35.550354 1834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff: No bootstrap required, opened a new log
I20260811 16:51:35.552131 1834 raft_consensus.cc:348] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c584a559205f45debb3ec78130c72cff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37767 } }
I20260811 16:51:35.552270 1834 raft_consensus.cc:374] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:35.552292 1834 raft_consensus.cc:729] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c584a559205f45debb3ec78130c72cff, State: Initialized, Role: FOLLOWER
I20260811 16:51:35.552394 1834 consensus_queue.cc:260] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c584a559205f45debb3ec78130c72cff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37767 } }
I20260811 16:51:35.552446 1834 raft_consensus.cc:388] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:35.552469 1834 raft_consensus.cc:482] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:35.552552 1834 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:35.553182 1834 raft_consensus.cc:504] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c584a559205f45debb3ec78130c72cff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37767 } }
I20260811 16:51:35.553298 1834 leader_election.cc:302] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c584a559205f45debb3ec78130c72cff; no voters:
I20260811 16:51:35.553484 1834 leader_election.cc:288] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:35.553557 1837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:35.553738 1837 raft_consensus.cc:686] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [term 1 LEADER]: Becoming Leader. State: Replica: c584a559205f45debb3ec78130c72cff, State: Running, Role: LEADER
I20260811 16:51:35.553782 1834 sys_catalog.cc:564] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:35.553859 1837 consensus_queue.cc:237] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c584a559205f45debb3ec78130c72cff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37767 } }
I20260811 16:51:35.554374 1840 sys_catalog.cc:455] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [sys.catalog]: SysCatalogTable state changed. Reason: New leader c584a559205f45debb3ec78130c72cff. Latest consensus state: current_term: 1 leader_uuid: "c584a559205f45debb3ec78130c72cff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c584a559205f45debb3ec78130c72cff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37767 } } }
I20260811 16:51:35.554497 1840 sys_catalog.cc:458] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:35.554527 1838 sys_catalog.cc:455] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c584a559205f45debb3ec78130c72cff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c584a559205f45debb3ec78130c72cff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37767 } } }
I20260811 16:51:35.554657 1838 sys_catalog.cc:458] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:35.554741 1849 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:35.555291 1849 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:35.555584 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 1710
I20260811 16:51:35.555704 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:35.555915 2270 external_mini_cluster.cc:1428] Setting key f07f122596694201cd611f29d6269c48
I20260811 16:51:35.557878 1849 catalog_manager.cc:1347] Generated new cluster ID: dc4eca98dbea4225a1bfbbfaa3a85fd1
I20260811 16:51:35.557933 1849 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:51:35 dist-test-slave-3h5h krb5kdc[1690](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 16:51:35.568563 1868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:35.556417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48585 (local address 127.0.0.1:37767)
0811 16:51:35.557308 (+ 891us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:35.557318 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:35.557351 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:51:35.557456 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:35.557462 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:35.557539 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:35.557685 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:35.558520 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:35.559908 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:35.561053 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:35.561668 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:35.561766 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:35.564706 (+ 2940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:35.564713 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:35.564713 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:35.564726 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:35.566800 (+ 2074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:35.567254 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:35.567258 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:35.567258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:35.567373 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:35.567615 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:35.567616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:35.567616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:35.567929 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:35.568117 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:35.568211 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 16:51:35.568319 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":843,"thread_start_us":81,"threads_started":1}
I20260811 16:51:35.569888 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:51:35.579803 1849 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:35.580310 1849 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:35.580607 1868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:35.573110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43565 (local address 127.0.0.1:37767)
0811 16:51:35.573147 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:35.573149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:35.573294 (+ 145us) server_negotiation.cc:407] Connection header received
0811 16:51:35.573339 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:35.573340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:35.573351 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:35.573404 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:35.574026 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:35.574812 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:35.575810 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:35.576136 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:35.576219 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:35.577620 (+ 1401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:35.577622 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:35.577623 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:35.577629 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:35.579264 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:35.579703 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:35.579704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:35.579705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:35.579760 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:35.579990 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:35.579991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:35.579991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:35.580111 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:35.580210 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:35.580449 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 16:51:35.580516 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:51:35.588413 1849 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c584a559205f45debb3ec78130c72cff: Generated new TSK 0
I20260811 16:51:35.588627 1849 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:35.598130 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 1710
W20260811 16:51:35.612890 1688 connection.cc:535] client connection to 127.0.0.1:37767 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37767): Connection reset by peer (error 104)
2026-08-11T16:51:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1606 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:35 dist-test-slave-3h5h krb5kdc[1878](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:35 dist-test-slave-3h5h krb5kdc[1878](info): set up 2 sockets
Aug 11 16:51:35 dist-test-slave-3h5h krb5kdc[1878](info): commencing operation
krb5kdc: starting...
W20260811 16:51:36.936282 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.309s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:37 dist-test-slave-3h5h krb5kdc[1878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:51:37.075553 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36951
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36951
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:37.162680 1898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:37.162935 1898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:37.162977 1898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:37.164134 1898 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:37.164208 1898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:37.164234 1898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:37.164261 1898 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:37.164294 1898 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:37.165952 1898 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36951
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:37.166267 1898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:37.166512 1898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:37.171838 1904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:37.171841 1906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:37.171844 1910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:37.172175 1898 server_base.cc:1034] running on GCE node
I20260811 16:51:37.172405 1898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:37.172657 1898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:37.173811 1898 hybrid_clock.cc:648] HybridClock initialized: now 1786467097173773 us; error 34 us; skew 500 ppm
Aug 11 16:51:37 dist-test-slave-3h5h krb5kdc[1878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467097, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:37.176401 1898 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:51:37.176949 1898 webserver.cc:460] Webserver started at http://127.0.0.1:38581/ using document root <none> and password file <none>
I20260811 16:51:37.177241 1898 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:37.177320 1898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:37.177496 1898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:37.178619 1898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "3ff2af49caa94224823e6b76659d4220"
format_stamp: "Formatted at 2026-08-11 16:51:37 on dist-test-slave-3h5h"
server_key: "7862ad0cb8c4901a686cc86621600a56"
server_key_iv: "7e9fb91900b6c9d9989a473126bf5cd4"
server_key_version: "encryptionkey@0"
I20260811 16:51:37.179010 1898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "3ff2af49caa94224823e6b76659d4220"
format_stamp: "Formatted at 2026-08-11 16:51:37 on dist-test-slave-3h5h"
server_key: "7862ad0cb8c4901a686cc86621600a56"
server_key_iv: "7e9fb91900b6c9d9989a473126bf5cd4"
server_key_version: "encryptionkey@0"
I20260811 16:51:37.180495 1898 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:51:37.181449 1919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:37.181646 1898 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:51:37.181757 1898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "3ff2af49caa94224823e6b76659d4220"
format_stamp: "Formatted at 2026-08-11 16:51:37 on dist-test-slave-3h5h"
server_key: "7862ad0cb8c4901a686cc86621600a56"
server_key_iv: "7e9fb91900b6c9d9989a473126bf5cd4"
server_key_version: "encryptionkey@0"
I20260811 16:51:37.181838 1898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:37.192039 1898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:37.194500 1898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:37.194671 1898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:37.198940 1898 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36951
I20260811 16:51:37.199016 2020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36951 every 8 connection(s)
I20260811 16:51:37.199378 1898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:37.200436 2021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:37.201713 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 1898
I20260811 16:51:37.201848 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:37.202051 2270 external_mini_cluster.cc:1428] Setting key 5248872692eeba304246e24c0b4a207c
I20260811 16:51:37.203341 2021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220: Bootstrap starting.
I20260811 16:51:37.204125 2021 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:37.204450 2021 log.cc:824] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:37.205307 2021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220: No bootstrap required, opened a new log
I20260811 16:51:37.207535 2021 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ff2af49caa94224823e6b76659d4220" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36951 } }
I20260811 16:51:37.207721 2021 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:37.207767 2021 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ff2af49caa94224823e6b76659d4220, State: Initialized, Role: FOLLOWER
I20260811 16:51:37.207906 2021 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ff2af49caa94224823e6b76659d4220" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36951 } }
I20260811 16:51:37.208014 2021 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:37.208066 2021 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:37.208123 2021 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:37.208416 2026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:37.202623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32831 (local address 127.0.0.1:36951)
0811 16:51:37.202829 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:37.202839 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:37.202879 (+ 40us) server_negotiation.cc:407] Connection header received
0811 16:51:37.203460 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:37.203469 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:37.203538 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:37.203702 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:37.203864 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:37.205395 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:37.206204 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:37.206856 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:37.207002 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:37.207665 (+ 663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:37.207669 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:37.207670 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:37.207881 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:37.207922 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:37.207936 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:37.208028 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:37.208220 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 16:51:37.208249 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":93,"threads_started":1}
I20260811 16:51:37.208771 2021 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ff2af49caa94224823e6b76659d4220" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36951 } }
I20260811 16:51:37.208920 2021 leader_election.cc:302] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ff2af49caa94224823e6b76659d4220; no voters:
I20260811 16:51:37.209151 2021 leader_election.cc:288] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:37.209170 2031 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:37.209291 2031 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [term 1 LEADER]: Becoming Leader. State: Replica: 3ff2af49caa94224823e6b76659d4220, State: Running, Role: LEADER
I20260811 16:51:37.209419 2021 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:37.209456 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:51:37.209431 2031 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ff2af49caa94224823e6b76659d4220" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36951 } }
I20260811 16:51:37.209818 2031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ff2af49caa94224823e6b76659d4220. Latest consensus state: current_term: 1 leader_uuid: "3ff2af49caa94224823e6b76659d4220" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ff2af49caa94224823e6b76659d4220" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36951 } } }
I20260811 16:51:37.209967 2031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:37.210441 2045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:37.210987 2045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:37.211043 2032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ff2af49caa94224823e6b76659d4220" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ff2af49caa94224823e6b76659d4220" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36951 } } }
I20260811 16:51:37.211145 2032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:37.212702 2045 catalog_manager.cc:1347] Generated new cluster ID: a7398fa537c14d67be339a750dd7df59
I20260811 16:51:37.212787 2045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:37.221140 2026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:37.217315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53423 (local address 127.0.0.1:36951)
0811 16:51:37.217361 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:37.217364 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:37.217565 (+ 201us) server_negotiation.cc:407] Connection header received
0811 16:51:37.217618 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:37.217619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:37.217630 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:37.217695 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:37.217856 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:37.218585 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:37.219630 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:37.219950 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:37.220019 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:37.220810 (+ 791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:37.220812 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:37.220812 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:37.220817 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:37.220867 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:37.220873 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:37.220932 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:37.221048 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 16:51:37.221060 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:51:37.234655 2045 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:37.235306 2045 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:37.249068 2045 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ff2af49caa94224823e6b76659d4220: Generated new TSK 0
I20260811 16:51:37.249301 2045 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:37.253948 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 1898
W20260811 16:51:37.282349 1875 connection.cc:535] client connection to 127.0.0.1:36951 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36951): Connection reset by peer (error 104)
2026-08-11T16:51:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1669 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:37 dist-test-slave-3h5h krb5kdc[2068](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:37 dist-test-slave-3h5h krb5kdc[2068](info): set up 2 sockets
Aug 11 16:51:37 dist-test-slave-3h5h krb5kdc[2068](info): commencing operation
krb5kdc: starting...
W20260811 16:51:38.534981 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:38 dist-test-slave-3h5h krb5kdc[2068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:51:38.667575 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33613
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33613
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:38.751770 2093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:38.751987 2093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:38.752010 2093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:38.753127 2093 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:38.753165 2093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:38.753178 2093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:38.753191 2093 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:38.753203 2093 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:38.754670 2093 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33613
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:38.754880 2093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:38.755074 2093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:51:38.760413 2093 server_base.cc:1034] running on GCE node
W20260811 16:51:38.760445 2102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:38.760375 2101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:38.760396 2105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:38.761056 2093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:38.761433 2093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:38.762632 2093 hybrid_clock.cc:648] HybridClock initialized: now 1786467098762635 us; error 48 us; skew 500 ppm
Aug 11 16:51:38 dist-test-slave-3h5h krb5kdc[2068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467098, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:38.765472 2093 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:51:38.766001 2093 webserver.cc:460] Webserver started at http://127.0.0.1:45189/ using document root <none> and password file <none>
I20260811 16:51:38.766305 2093 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:38.766381 2093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:38.766534 2093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:38.767663 2093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "578fd7ab79884dc29a4f1d4c1094f9da"
format_stamp: "Formatted at 2026-08-11 16:51:38 on dist-test-slave-3h5h"
server_key: "ba360657ba9cf5be0f6d052494905c1b"
server_key_iv: "53024e22a42671659bfc8abc785821af"
server_key_version: "encryptionkey@0"
I20260811 16:51:38.768026 2093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "578fd7ab79884dc29a4f1d4c1094f9da"
format_stamp: "Formatted at 2026-08-11 16:51:38 on dist-test-slave-3h5h"
server_key: "ba360657ba9cf5be0f6d052494905c1b"
server_key_iv: "53024e22a42671659bfc8abc785821af"
server_key_version: "encryptionkey@0"
I20260811 16:51:38.769546 2093 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:51:38.770433 2120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:38.770699 2093 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:38.770824 2093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "578fd7ab79884dc29a4f1d4c1094f9da"
format_stamp: "Formatted at 2026-08-11 16:51:38 on dist-test-slave-3h5h"
server_key: "ba360657ba9cf5be0f6d052494905c1b"
server_key_iv: "53024e22a42671659bfc8abc785821af"
server_key_version: "encryptionkey@0"
I20260811 16:51:38.770906 2093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:38.774439 2093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:38.776580 2093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:38.776742 2093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:38.781234 2093 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33613
I20260811 16:51:38.781271 2205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33613 every 8 connection(s)
I20260811 16:51:38.781633 2093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:38.782672 2209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:38.783442 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 2093
I20260811 16:51:38.783571 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:38.783797 2270 external_mini_cluster.cc:1428] Setting key 901c2c7d90b6df9425472f0ebeba7631
I20260811 16:51:38.786053 2209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da: Bootstrap starting.
I20260811 16:51:38.786319 2212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:38.784368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46765 (local address 127.0.0.1:33613)
0811 16:51:38.784544 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:38.784551 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:38.784579 (+ 28us) server_negotiation.cc:407] Connection header received
0811 16:51:38.785049 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:38.785056 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:38.785082 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:38.785202 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:38.785851 (+ 649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:38.785855 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:38.785855 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:38.785858 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:38.785894 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:38.785904 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:38.785961 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:38.786056 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 16:51:38.786116 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
I20260811 16:51:38.786827 2209 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:38.787189 2209 log.cc:824] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:38.787415 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:51:38.787945 2209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da: No bootstrap required, opened a new log
I20260811 16:51:38.789947 2212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:38.788910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50319 (local address 127.0.0.1:33613)
0811 16:51:38.788957 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:38.788959 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:38.788969 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:51:38.789047 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:38.789048 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:38.789052 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:38.789114 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:38.789717 (+ 603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:38.789718 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:38.789719 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:38.789723 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:38.789741 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:38.789745 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:38.789825 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:38.789857 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 16:51:38.789872 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:51:38.790407 2209 raft_consensus.cc:348] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578fd7ab79884dc29a4f1d4c1094f9da" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33613 } }
I20260811 16:51:38.790582 2209 raft_consensus.cc:374] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:38.790637 2209 raft_consensus.cc:729] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 578fd7ab79884dc29a4f1d4c1094f9da, State: Initialized, Role: FOLLOWER
I20260811 16:51:38.790757 2209 consensus_queue.cc:260] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578fd7ab79884dc29a4f1d4c1094f9da" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33613 } }
I20260811 16:51:38.790846 2209 raft_consensus.cc:388] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:38.790889 2209 raft_consensus.cc:482] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:38.790939 2209 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:38.791463 2209 raft_consensus.cc:504] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578fd7ab79884dc29a4f1d4c1094f9da" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33613 } }
I20260811 16:51:38.791596 2209 leader_election.cc:302] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 578fd7ab79884dc29a4f1d4c1094f9da; no voters:
I20260811 16:51:38.791783 2209 leader_election.cc:288] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:38.791817 2224 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:38.792012 2224 raft_consensus.cc:686] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [term 1 LEADER]: Becoming Leader. State: Replica: 578fd7ab79884dc29a4f1d4c1094f9da, State: Running, Role: LEADER
I20260811 16:51:38.792037 2209 sys_catalog.cc:564] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:38.792151 2224 consensus_queue.cc:237] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578fd7ab79884dc29a4f1d4c1094f9da" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33613 } }
I20260811 16:51:38.792604 2227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 578fd7ab79884dc29a4f1d4c1094f9da. Latest consensus state: current_term: 1 leader_uuid: "578fd7ab79884dc29a4f1d4c1094f9da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578fd7ab79884dc29a4f1d4c1094f9da" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33613 } } }
I20260811 16:51:38.792762 2227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:38.792585 2225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "578fd7ab79884dc29a4f1d4c1094f9da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "578fd7ab79884dc29a4f1d4c1094f9da" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33613 } } }
I20260811 16:51:38.793149 2225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da [sys.catalog]: This master's current role is: LEADER
W20260811 16:51:38.793879 2250 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:51:38.793943 2250 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:51:38.794018 2241 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:38.794198 2241 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:38.795611 2241 catalog_manager.cc:1347] Generated new cluster ID: c53571ac857b49bd9c2f63e7117b844b
I20260811 16:51:38.795665 2241 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:38.829602 2241 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:38.829818 2241 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:38.836622 2241 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 578fd7ab79884dc29a4f1d4c1094f9da: Generated new TSK 0
I20260811 16:51:38.836863 2241 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:38.847956 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 2093
2026-08-11T16:51:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1580 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:38 dist-test-slave-3h5h krb5kdc[2259](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:38 dist-test-slave-3h5h krb5kdc[2259](info): set up 2 sockets
Aug 11 16:51:38 dist-test-slave-3h5h krb5kdc[2259](info): commencing operation
krb5kdc: starting...
W20260811 16:51:40.151662 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.007s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:40 dist-test-slave-3h5h krb5kdc[2259](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:51:40.283787 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43825
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:40.385269 2288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:40.385495 2288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:40.385521 2288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:40.386745 2288 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:40.386797 2288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:40.386814 2288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:40.386828 2288 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:40.386842 2288 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:40.388384 2288 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:40.388661 2288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:40.388927 2288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:40.394095 2294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:40.394058 2296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:40.394058 2301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:40.394320 2288 server_base.cc:1034] running on GCE node
I20260811 16:51:40.394608 2288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:40.394894 2288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:40.396037 2288 hybrid_clock.cc:648] HybridClock initialized: now 1786467100396017 us; error 40 us; skew 500 ppm
Aug 11 16:51:40 dist-test-slave-3h5h krb5kdc[2259](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467100, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:40.398677 2288 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:51:40.399051 2288 webserver.cc:460] Webserver started at http://127.0.0.1:43547/ using document root <none> and password file <none>
I20260811 16:51:40.399277 2288 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:40.399343 2288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:40.399435 2288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:40.400416 2288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "cb50c3f451b9455dbacf88df01582bba"
format_stamp: "Formatted at 2026-08-11 16:51:40 on dist-test-slave-3h5h"
server_key: "447791e3a242ba7bebf89b47d0950577"
server_key_iv: "0674e0accac92f6dab2e3c8455d9c436"
server_key_version: "encryptionkey@0"
I20260811 16:51:40.400727 2288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "cb50c3f451b9455dbacf88df01582bba"
format_stamp: "Formatted at 2026-08-11 16:51:40 on dist-test-slave-3h5h"
server_key: "447791e3a242ba7bebf89b47d0950577"
server_key_iv: "0674e0accac92f6dab2e3c8455d9c436"
server_key_version: "encryptionkey@0"
I20260811 16:51:40.402101 2288 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:51:40.402796 2312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:40.402973 2288 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:51:40.403081 2288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "cb50c3f451b9455dbacf88df01582bba"
format_stamp: "Formatted at 2026-08-11 16:51:40 on dist-test-slave-3h5h"
server_key: "447791e3a242ba7bebf89b47d0950577"
server_key_iv: "0674e0accac92f6dab2e3c8455d9c436"
server_key_version: "encryptionkey@0"
I20260811 16:51:40.403164 2288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:40.412791 2288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:40.414765 2288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:40.414948 2288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:40.419207 2288 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43825
I20260811 16:51:40.419261 2407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43825 every 8 connection(s)
I20260811 16:51:40.419673 2288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:40.420719 2408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:40.423058 2408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba: Bootstrap starting.
I20260811 16:51:40.423661 2408 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:40.423965 2408 log.cc:824] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:40.424686 2408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba: No bootstrap required, opened a new log
I20260811 16:51:40.426405 2408 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb50c3f451b9455dbacf88df01582bba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43825 } }
I20260811 16:51:40.426540 2408 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:40.426563 2408 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb50c3f451b9455dbacf88df01582bba, State: Initialized, Role: FOLLOWER
I20260811 16:51:40.426757 2408 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb50c3f451b9455dbacf88df01582bba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43825 } }
I20260811 16:51:40.426844 2408 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:40.426903 2408 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:40.426959 2408 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:40.427496 2408 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb50c3f451b9455dbacf88df01582bba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43825 } }
I20260811 16:51:40.427609 2408 leader_election.cc:302] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb50c3f451b9455dbacf88df01582bba; no voters:
I20260811 16:51:40.427796 2408 leader_election.cc:288] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:40.427831 2413 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:40.428013 2413 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [term 1 LEADER]: Becoming Leader. State: Replica: cb50c3f451b9455dbacf88df01582bba, State: Running, Role: LEADER
I20260811 16:51:40.428061 2408 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:40.428143 2413 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb50c3f451b9455dbacf88df01582bba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43825 } }
I20260811 16:51:40.428552 2415 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb50c3f451b9455dbacf88df01582bba. Latest consensus state: current_term: 1 leader_uuid: "cb50c3f451b9455dbacf88df01582bba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb50c3f451b9455dbacf88df01582bba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43825 } } }
I20260811 16:51:40.428637 2415 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:40.428711 2414 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb50c3f451b9455dbacf88df01582bba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb50c3f451b9455dbacf88df01582bba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43825 } } }
I20260811 16:51:40.428799 2414 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:40.429140 2425 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:40.429728 2425 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:40.429847 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 2288
I20260811 16:51:40.429991 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:40.430209 2270 external_mini_cluster.cc:1428] Setting key 6e5dbbc988689051c1d2b16dfabf2f5d
I20260811 16:51:40.431807 2425 catalog_manager.cc:1347] Generated new cluster ID: 5072d93e5db24c5eafdca543632e7e76
I20260811 16:51:40.431866 2425 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:51:40 dist-test-slave-3h5h krb5kdc[2259](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 16:51:40.436908 2425 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:40.438215 2425 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:40.441273 2441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:40.430672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51989 (local address 127.0.0.1:43825)
0811 16:51:40.430839 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:40.430849 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:40.431042 (+ 193us) server_negotiation.cc:407] Connection header received
0811 16:51:40.431183 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:40.431191 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:40.431247 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:40.431387 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:40.432181 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:40.433261 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:40.434065 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:40.434491 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:40.434614 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:40.437499 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:40.437503 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:40.437504 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:40.437520 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:40.439580 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:40.439994 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:40.439997 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:40.439998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:40.440106 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:40.440324 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:40.440325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:40.440325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:40.440588 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:40.440742 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:40.440893 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 16:51:40.441040 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
I20260811 16:51:40.441701 2425 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb50c3f451b9455dbacf88df01582bba: Generated new TSK 0
I20260811 16:51:40.441855 2425 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:40.442391 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:51:40.450347 2441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:40.443821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54131 (local address 127.0.0.1:43825)
0811 16:51:40.443862 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:40.443863 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:40.443932 (+ 69us) server_negotiation.cc:407] Connection header received
0811 16:51:40.444011 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:40.444012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:40.444019 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:40.444066 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:40.444685 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:40.445232 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:40.446288 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:40.446485 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:40.446536 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:40.447847 (+ 1311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:40.447848 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:40.447848 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:40.447854 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:40.449289 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:40.449666 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:40.449667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:40.449667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:40.449718 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:40.449918 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:40.449919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:40.449919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:40.450011 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:40.450091 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:40.450231 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 16:51:40.450290 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:51:40.452322 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 2288
2026-08-11T16:51:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1602 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:40 dist-test-slave-3h5h krb5kdc[2455](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:40 dist-test-slave-3h5h krb5kdc[2455](info): set up 2 sockets
Aug 11 16:51:40 dist-test-slave-3h5h krb5kdc[2455](info): commencing operation
krb5kdc: starting...
W20260811 16:51:41.727970 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:41 dist-test-slave-3h5h krb5kdc[2455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467101, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:51:41.861178 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43511
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43511
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:41.951303 2473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:41.951578 2473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:41.951624 2473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:41.952788 2473 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:41.952898 2473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:41.952939 2473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:41.952979 2473 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:41.953012 2473 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:41.954571 2473 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43511
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:41.954866 2473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:41.955142 2473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:41.960402 2485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:41.960461 2481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:41.960419 2482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:41.960649 2473 server_base.cc:1034] running on GCE node
I20260811 16:51:41.961071 2473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:41.961391 2473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:41.962587 2473 hybrid_clock.cc:648] HybridClock initialized: now 1786467101962539 us; error 49 us; skew 500 ppm
Aug 11 16:51:41 dist-test-slave-3h5h krb5kdc[2455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467101, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:41.965458 2473 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:51:41.965917 2473 webserver.cc:460] Webserver started at http://127.0.0.1:45741/ using document root <none> and password file <none>
I20260811 16:51:41.966156 2473 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:41.966228 2473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:41.966393 2473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:41.967576 2473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "5c327d3c8e864c319d18194d8340e884"
format_stamp: "Formatted at 2026-08-11 16:51:41 on dist-test-slave-3h5h"
server_key: "729bca7d3a8c7ab79bae9d639d9c3360"
server_key_iv: "aad2d8651a75648b36a1bf76b40ae94a"
server_key_version: "encryptionkey@0"
I20260811 16:51:41.967959 2473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "5c327d3c8e864c319d18194d8340e884"
format_stamp: "Formatted at 2026-08-11 16:51:41 on dist-test-slave-3h5h"
server_key: "729bca7d3a8c7ab79bae9d639d9c3360"
server_key_iv: "aad2d8651a75648b36a1bf76b40ae94a"
server_key_version: "encryptionkey@0"
I20260811 16:51:41.969507 2473 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:51:41.970391 2499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:41.970628 2473 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:51:41.970755 2473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "5c327d3c8e864c319d18194d8340e884"
format_stamp: "Formatted at 2026-08-11 16:51:41 on dist-test-slave-3h5h"
server_key: "729bca7d3a8c7ab79bae9d639d9c3360"
server_key_iv: "aad2d8651a75648b36a1bf76b40ae94a"
server_key_version: "encryptionkey@0"
I20260811 16:51:41.970840 2473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:41.999254 2473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:42.001547 2473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:42.001737 2473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:42.006175 2473 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43511
I20260811 16:51:42.006237 2586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43511 every 8 connection(s)
I20260811 16:51:42.006646 2473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:42.007608 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 2473
I20260811 16:51:42.007754 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:42.007851 2587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:42.007995 2270 external_mini_cluster.cc:1428] Setting key 58b1e05710a6509db184b749b7b6194a
I20260811 16:51:42.011376 2587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884: Bootstrap starting.
I20260811 16:51:42.012126 2587 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:42.012452 2587 log.cc:824] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:42.013458 2587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884: No bootstrap required, opened a new log
I20260811 16:51:42.014147 2592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:42.008591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56199 (local address 127.0.0.1:43511)
0811 16:51:42.008787 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:42.008795 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:42.008822 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:51:42.009487 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:42.009495 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:42.009546 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:42.009671 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:42.009923 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:42.010804 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:42.011935 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:42.012398 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:42.012483 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:42.013375 (+ 892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:42.013379 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:42.013379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:42.013621 (+ 242us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:42.013653 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:42.013665 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:42.013728 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:42.013835 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 16:51:42.013887 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":98,"threads_started":1}
I20260811 16:51:42.015619 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:51:42.015633 2587 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c327d3c8e864c319d18194d8340e884" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43511 } }
I20260811 16:51:42.015802 2587 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:42.015836 2587 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c327d3c8e864c319d18194d8340e884, State: Initialized, Role: FOLLOWER
I20260811 16:51:42.015964 2587 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c327d3c8e864c319d18194d8340e884" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43511 } }
I20260811 16:51:42.016047 2587 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:42.016074 2587 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:42.016111 2587 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:42.016952 2587 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c327d3c8e864c319d18194d8340e884" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43511 } }
I20260811 16:51:42.017098 2587 leader_election.cc:302] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c327d3c8e864c319d18194d8340e884; no voters:
I20260811 16:51:42.017282 2587 leader_election.cc:288] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:42.017331 2604 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:42.017539 2604 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [term 1 LEADER]: Becoming Leader. State: Replica: 5c327d3c8e864c319d18194d8340e884, State: Running, Role: LEADER
I20260811 16:51:42.017620 2587 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:42.017700 2604 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c327d3c8e864c319d18194d8340e884" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43511 } }
I20260811 16:51:42.019428 2607 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c327d3c8e864c319d18194d8340e884" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c327d3c8e864c319d18194d8340e884" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43511 } } }
I20260811 16:51:42.019822 2607 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:42.019564 2610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c327d3c8e864c319d18194d8340e884. Latest consensus state: current_term: 1 leader_uuid: "5c327d3c8e864c319d18194d8340e884" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c327d3c8e864c319d18194d8340e884" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43511 } } }
W20260811 16:51:42.019642 2632 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 16:51:42.020071 2610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884 [sys.catalog]: This master's current role is: LEADER
W20260811 16:51:42.020090 2632 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:51:42.020159 2634 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:42.020383 2634 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:42.021265 2592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:42.017368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55305 (local address 127.0.0.1:43511)
0811 16:51:42.017409 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:42.017411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:42.017557 (+ 146us) server_negotiation.cc:407] Connection header received
0811 16:51:42.017656 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:42.017657 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:42.017669 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:42.017701 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:42.017939 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:42.018739 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:42.019656 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:42.019964 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:42.020053 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:42.020944 (+ 891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:42.020945 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:42.020945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:42.020950 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:42.020965 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:42.020970 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:42.021020 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:42.021174 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 16:51:42.021198 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:51:42.022034 2634 catalog_manager.cc:1347] Generated new cluster ID: 81489aa32e4f42ed8637d734676f4a9d
I20260811 16:51:42.022094 2634 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:42.045526 2634 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:42.046288 2634 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:42.054840 2634 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c327d3c8e864c319d18194d8340e884: Generated new TSK 0
I20260811 16:51:42.055068 2634 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:42.058744 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 2473
2026-08-11T16:51:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1609 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:42 dist-test-slave-3h5h krb5kdc[2644](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:42 dist-test-slave-3h5h krb5kdc[2644](info): set up 2 sockets
Aug 11 16:51:42 dist-test-slave-3h5h krb5kdc[2644](info): commencing operation
krb5kdc: starting...
W20260811 16:51:43.389838 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.302s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:43 dist-test-slave-3h5h krb5kdc[2644](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467103, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:51:43.529858 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45913
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:43.621695 2670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:43.621965 2670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:43.622008 2670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:43.623183 2670 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:43.623268 2670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:43.623296 2670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:43.623327 2670 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:43.623361 2670 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:43.624905 2670 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45913
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:43.625209 2670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:43.625453 2670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:43.630761 2686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:43.630846 2683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:43.630760 2682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:43.631006 2670 server_base.cc:1034] running on GCE node
I20260811 16:51:43.631296 2670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:43.631603 2670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:43.632773 2670 hybrid_clock.cc:648] HybridClock initialized: now 1786467103632757 us; error 55 us; skew 500 ppm
Aug 11 16:51:43 dist-test-slave-3h5h krb5kdc[2644](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467103, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:43.635421 2670 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:51:43.635898 2670 webserver.cc:460] Webserver started at http://127.0.0.1:40021/ using document root <none> and password file <none>
I20260811 16:51:43.636168 2670 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:43.636245 2670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:43.636394 2670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:43.637506 2670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "de63b5f256de439f9ac3d0b3af7044bf"
format_stamp: "Formatted at 2026-08-11 16:51:43 on dist-test-slave-3h5h"
server_key: "18b38856182b687c5451385aff9e54b7"
server_key_iv: "a7512bf7e3bcfdf8a49211ef09f004f3"
server_key_version: "encryptionkey@0"
I20260811 16:51:43.637867 2670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "de63b5f256de439f9ac3d0b3af7044bf"
format_stamp: "Formatted at 2026-08-11 16:51:43 on dist-test-slave-3h5h"
server_key: "18b38856182b687c5451385aff9e54b7"
server_key_iv: "a7512bf7e3bcfdf8a49211ef09f004f3"
server_key_version: "encryptionkey@0"
I20260811 16:51:43.639282 2670 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:51:43.640231 2697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:43.640450 2670 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:43.640558 2670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "de63b5f256de439f9ac3d0b3af7044bf"
format_stamp: "Formatted at 2026-08-11 16:51:43 on dist-test-slave-3h5h"
server_key: "18b38856182b687c5451385aff9e54b7"
server_key_iv: "a7512bf7e3bcfdf8a49211ef09f004f3"
server_key_version: "encryptionkey@0"
I20260811 16:51:43.640641 2670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:43.644119 2670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:43.646456 2670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:43.646648 2670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:43.651023 2670 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45913
I20260811 16:51:43.651058 2783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45913 every 8 connection(s)
I20260811 16:51:43.651394 2670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:43.652464 2789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:43.654881 2789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf: Bootstrap starting.
I20260811 16:51:43.655506 2789 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:43.655804 2789 log.cc:824] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:43.656272 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 2670
I20260811 16:51:43.656406 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:43.656613 2270 external_mini_cluster.cc:1428] Setting key 3299a27c320142567e7b1270d5b47e9d
I20260811 16:51:43.656780 2789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf: No bootstrap required, opened a new log
I20260811 16:51:43.658826 2789 raft_consensus.cc:348] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de63b5f256de439f9ac3d0b3af7044bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45913 } }
I20260811 16:51:43.659080 2789 raft_consensus.cc:374] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:43.659178 2789 raft_consensus.cc:729] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de63b5f256de439f9ac3d0b3af7044bf, State: Initialized, Role: FOLLOWER
I20260811 16:51:43.659682 2789 consensus_queue.cc:260] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de63b5f256de439f9ac3d0b3af7044bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45913 } }
I20260811 16:51:43.659816 2789 raft_consensus.cc:388] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:43.659869 2789 raft_consensus.cc:482] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:43.659960 2789 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:43.660488 2794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:43.657239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44853 (local address 127.0.0.1:45913)
0811 16:51:43.657479 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:43.657489 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:43.657519 (+ 30us) server_negotiation.cc:407] Connection header received
0811 16:51:43.658811 (+ 1292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:43.658820 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:43.658851 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:43.658972 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:43.659763 (+ 791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:43.659767 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:43.659767 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:43.659771 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:43.659829 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:43.659846 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:43.659914 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:43.659989 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 16:51:43.660167 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":135,"threads_started":1}
I20260811 16:51:43.660595 2789 raft_consensus.cc:504] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de63b5f256de439f9ac3d0b3af7044bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45913 } }
I20260811 16:51:43.660744 2789 leader_election.cc:302] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de63b5f256de439f9ac3d0b3af7044bf; no voters:
I20260811 16:51:43.660970 2789 leader_election.cc:288] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:43.661000 2795 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:43.661125 2795 raft_consensus.cc:686] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [term 1 LEADER]: Becoming Leader. State: Replica: de63b5f256de439f9ac3d0b3af7044bf, State: Running, Role: LEADER
I20260811 16:51:43.661242 2789 sys_catalog.cc:564] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:43.661265 2795 consensus_queue.cc:237] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de63b5f256de439f9ac3d0b3af7044bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45913 } }
I20260811 16:51:43.661484 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:51:43.662508 2796 sys_catalog.cc:455] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de63b5f256de439f9ac3d0b3af7044bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de63b5f256de439f9ac3d0b3af7044bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45913 } } }
I20260811 16:51:43.662602 2796 sys_catalog.cc:458] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:43.663113 2797 sys_catalog.cc:455] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader de63b5f256de439f9ac3d0b3af7044bf. Latest consensus state: current_term: 1 leader_uuid: "de63b5f256de439f9ac3d0b3af7044bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de63b5f256de439f9ac3d0b3af7044bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45913 } } }
W20260811 16:51:43.663242 2826 catalog_manager.cc:1558] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 16:51:43.663277 2797 sys_catalog.cc:458] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf [sys.catalog]: This master's current role is: LEADER
W20260811 16:51:43.663302 2826 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:51:43.663532 2825 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:43.663710 2825 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:43.665413 2794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:43.663276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54953 (local address 127.0.0.1:45913)
0811 16:51:43.663322 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:43.663325 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:43.664384 (+ 1059us) server_negotiation.cc:407] Connection header received
0811 16:51:43.664435 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:43.664436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:43.664443 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:43.664498 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:43.665193 (+ 695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:43.665194 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:43.665195 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:43.665199 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:43.665214 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:43.665219 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:43.665275 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:43.665331 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 16:51:43.665347 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:51:43.665474 2825 catalog_manager.cc:1347] Generated new cluster ID: 40344198931648069afa2ccf9898b223
I20260811 16:51:43.665513 2825 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:43.727747 2825 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:43.727957 2825 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:43.734297 2825 catalog_manager.cc:5868] T 00000000000000000000000000000000 P de63b5f256de439f9ac3d0b3af7044bf: Generated new TSK 0
I20260811 16:51:43.734519 2825 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:43.737118 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 2670
2026-08-11T16:51:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1675 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:43 dist-test-slave-3h5h krb5kdc[2836](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:43 dist-test-slave-3h5h krb5kdc[2836](info): set up 2 sockets
Aug 11 16:51:43 dist-test-slave-3h5h krb5kdc[2836](info): commencing operation
krb5kdc: starting...
W20260811 16:51:45.017464 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:45 dist-test-slave-3h5h krb5kdc[2836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467105, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:51:45.156368 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45927
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:45.242545 2858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:45.242798 2858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:45.242838 2858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:45.243981 2858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:45.244071 2858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:45.244095 2858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:45.244117 2858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:45.244148 2858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:45.245718 2858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:45.246032 2858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:45.246274 2858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:45.251705 2870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:45.251705 2866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:45.251719 2868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:45.251919 2858 server_base.cc:1034] running on GCE node
I20260811 16:51:45.252321 2858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:45.252631 2858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:45.253787 2858 hybrid_clock.cc:648] HybridClock initialized: now 1786467105253773 us; error 55 us; skew 500 ppm
Aug 11 16:51:45 dist-test-slave-3h5h krb5kdc[2836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467105, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:45.256450 2858 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:51:45.256980 2858 webserver.cc:460] Webserver started at http://127.0.0.1:41413/ using document root <none> and password file <none>
I20260811 16:51:45.257279 2858 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:45.257356 2858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:45.257506 2858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:45.258613 2858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "3a7cf88d6bc64e6182f71cfa4164bc0b"
format_stamp: "Formatted at 2026-08-11 16:51:45 on dist-test-slave-3h5h"
server_key: "4f3d53fdbc5a1ec1b74289076a889b42"
server_key_iv: "6a9cda10871197a6b2bbfb21cc2bcdee"
server_key_version: "encryptionkey@0"
I20260811 16:51:45.258987 2858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "3a7cf88d6bc64e6182f71cfa4164bc0b"
format_stamp: "Formatted at 2026-08-11 16:51:45 on dist-test-slave-3h5h"
server_key: "4f3d53fdbc5a1ec1b74289076a889b42"
server_key_iv: "6a9cda10871197a6b2bbfb21cc2bcdee"
server_key_version: "encryptionkey@0"
I20260811 16:51:45.260370 2858 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:51:45.261155 2882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:45.261333 2858 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:51:45.261445 2858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "3a7cf88d6bc64e6182f71cfa4164bc0b"
format_stamp: "Formatted at 2026-08-11 16:51:45 on dist-test-slave-3h5h"
server_key: "4f3d53fdbc5a1ec1b74289076a889b42"
server_key_iv: "6a9cda10871197a6b2bbfb21cc2bcdee"
server_key_version: "encryptionkey@0"
I20260811 16:51:45.261520 2858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:45.270102 2858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:45.272308 2858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:45.272498 2858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:45.277000 2858 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45927
I20260811 16:51:45.277034 2965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45927 every 8 connection(s)
I20260811 16:51:45.277421 2858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:45.278512 2966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:45.281005 2966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b: Bootstrap starting.
I20260811 16:51:45.281634 2966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:45.281952 2966 log.cc:824] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:45.282267 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 2858
I20260811 16:51:45.282407 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:45.282606 2270 external_mini_cluster.cc:1428] Setting key 651779d7967034eb9d68a32d40a2b168
I20260811 16:51:45.282822 2966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b: No bootstrap required, opened a new log
I20260811 16:51:45.285090 2966 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7cf88d6bc64e6182f71cfa4164bc0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45927 } }
I20260811 16:51:45.285269 2966 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:45.285338 2966 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a7cf88d6bc64e6182f71cfa4164bc0b, State: Initialized, Role: FOLLOWER
I20260811 16:51:45.285516 2966 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7cf88d6bc64e6182f71cfa4164bc0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45927 } }
I20260811 16:51:45.285614 2966 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:45.285668 2966 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:45.285718 2966 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:45.286299 2966 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7cf88d6bc64e6182f71cfa4164bc0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45927 } }
I20260811 16:51:45.286419 2966 leader_election.cc:302] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a7cf88d6bc64e6182f71cfa4164bc0b; no voters:
I20260811 16:51:45.286624 2966 leader_election.cc:288] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:45.286679 2975 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:45.286834 2975 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [term 1 LEADER]: Becoming Leader. State: Replica: 3a7cf88d6bc64e6182f71cfa4164bc0b, State: Running, Role: LEADER
I20260811 16:51:45.286906 2966 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:45.287005 2975 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7cf88d6bc64e6182f71cfa4164bc0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45927 } }
I20260811 16:51:45.287415 2975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a7cf88d6bc64e6182f71cfa4164bc0b. Latest consensus state: current_term: 1 leader_uuid: "3a7cf88d6bc64e6182f71cfa4164bc0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7cf88d6bc64e6182f71cfa4164bc0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45927 } } }
I20260811 16:51:45.287545 2975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:45.287431 2984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a7cf88d6bc64e6182f71cfa4164bc0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7cf88d6bc64e6182f71cfa4164bc0b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45927 } } }
I20260811 16:51:45.287659 2984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:45.287894 2995 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:45.288605 2995 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:45.290351 2995 catalog_manager.cc:1347] Generated new cluster ID: 6581e8dc8041433dbf6fb3134b85620d
I20260811 16:51:45.290403 2995 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:51:45 dist-test-slave-3h5h krb5kdc[2836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467105, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 16:51:45.295909 2972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:45.283294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.218:44781 (local address 127.0.0.1:45927)
0811 16:51:45.283485 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:45.283494 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:45.283529 (+ 35us) server_negotiation.cc:407] Connection header received
0811 16:51:45.284277 (+ 748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:45.284286 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:45.284341 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:45.284497 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:45.285260 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:45.286638 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:45.287752 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:45.288395 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:45.288858 (+ 463us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:45.291359 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:45.291363 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:45.291363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:45.291375 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:45.293546 (+ 2171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:45.294046 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:45.294049 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:45.294050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:45.294167 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:45.294542 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:45.294543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:45.294543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:45.294852 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:45.295016 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:45.295579 (+ 563us) server_negotiation.cc:299] Negotiation successful
0811 16:51:45.295691 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":81,"threads_started":1}
I20260811 16:51:45.300556 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:51:45.314486 2972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:45.302026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.218:58085 (local address 127.0.0.1:45927)
0811 16:51:45.302561 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:45.302563 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:45.302601 (+ 38us) server_negotiation.cc:407] Connection header received
0811 16:51:45.302621 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:45.302622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:45.302631 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:45.302679 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:45.303327 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:45.304113 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:45.305137 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:45.305485 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:45.305562 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:45.311437 (+ 5875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:45.311438 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:45.311439 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:45.311447 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:45.313228 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:45.313644 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:45.313646 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:45.313646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:45.313724 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:45.313954 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:45.313955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:45.313956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:45.314096 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:45.314211 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:45.314320 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 16:51:45.314386 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513}
I20260811 16:51:45.329783 2995 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:45.330554 2995 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:45.339206 2995 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a7cf88d6bc64e6182f71cfa4164bc0b: Generated new TSK 0
I20260811 16:51:45.339438 2995 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:45.342581 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 2858
W20260811 16:51:45.355558 2833 connection.cc:535] client connection to 127.0.0.1:45927 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45927): Connection reset by peer (error 104)
2026-08-11T16:51:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1605 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:45 dist-test-slave-3h5h krb5kdc[3023](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:45 dist-test-slave-3h5h krb5kdc[3023](info): set up 2 sockets
Aug 11 16:51:45 dist-test-slave-3h5h krb5kdc[3023](info): commencing operation
krb5kdc: starting...
W20260811 16:51:46.595752 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:46 dist-test-slave-3h5h krb5kdc[3023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:51:46.730155 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41329
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:46.815797 3047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:46.816085 3047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:46.816129 3047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:46.817337 3047 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:46.817413 3047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:46.817437 3047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:46.817462 3047 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:46.817481 3047 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:46.819051 3047 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:46.819357 3047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:46.819614 3047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:46.824785 3053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:46.824816 3057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:46.824792 3054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:46.825083 3047 server_base.cc:1034] running on GCE node
I20260811 16:51:46.825366 3047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:46.825709 3047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:46.826897 3047 hybrid_clock.cc:648] HybridClock initialized: now 1786467106826893 us; error 41 us; skew 500 ppm
Aug 11 16:51:46 dist-test-slave-3h5h krb5kdc[3023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467106, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:46.829631 3047 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:51:46.830122 3047 webserver.cc:460] Webserver started at http://127.0.0.1:41825/ using document root <none> and password file <none>
I20260811 16:51:46.830372 3047 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:46.830446 3047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:46.830602 3047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:46.831729 3047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "547076af8d344cce950a56878464322e"
format_stamp: "Formatted at 2026-08-11 16:51:46 on dist-test-slave-3h5h"
server_key: "f0f2c1ff910b23298e519c7212906d81"
server_key_iv: "ea9781d612165837bd0f7574e892bf46"
server_key_version: "encryptionkey@0"
I20260811 16:51:46.832115 3047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "547076af8d344cce950a56878464322e"
format_stamp: "Formatted at 2026-08-11 16:51:46 on dist-test-slave-3h5h"
server_key: "f0f2c1ff910b23298e519c7212906d81"
server_key_iv: "ea9781d612165837bd0f7574e892bf46"
server_key_version: "encryptionkey@0"
I20260811 16:51:46.833627 3047 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:51:46.834560 3069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:46.834831 3047 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:46.834951 3047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "547076af8d344cce950a56878464322e"
format_stamp: "Formatted at 2026-08-11 16:51:46 on dist-test-slave-3h5h"
server_key: "f0f2c1ff910b23298e519c7212906d81"
server_key_iv: "ea9781d612165837bd0f7574e892bf46"
server_key_version: "encryptionkey@0"
I20260811 16:51:46.835031 3047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:46.848343 3047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:46.851238 3047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:46.851410 3047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:46.855970 3047 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41329
I20260811 16:51:46.856043 3153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41329 every 8 connection(s)
I20260811 16:51:46.856431 3047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:46.857604 3154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:46.859992 3154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e: Bootstrap starting.
I20260811 16:51:46.860610 3154 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:46.860960 3154 log.cc:824] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:46.861747 3154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e: No bootstrap required, opened a new log
I20260811 16:51:46.863488 3154 raft_consensus.cc:348] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547076af8d344cce950a56878464322e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41329 } }
I20260811 16:51:46.863634 3154 raft_consensus.cc:374] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:46.863656 3154 raft_consensus.cc:729] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 547076af8d344cce950a56878464322e, State: Initialized, Role: FOLLOWER
I20260811 16:51:46.863816 3154 consensus_queue.cc:260] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547076af8d344cce950a56878464322e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41329 } }
I20260811 16:51:46.863909 3154 raft_consensus.cc:388] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:46.863933 3154 raft_consensus.cc:482] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:46.863972 3154 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:46.864527 3154 raft_consensus.cc:504] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547076af8d344cce950a56878464322e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41329 } }
I20260811 16:51:46.864619 3154 leader_election.cc:302] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 547076af8d344cce950a56878464322e; no voters:
I20260811 16:51:46.864763 3154 leader_election.cc:288] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:46.864835 3160 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:46.865033 3160 raft_consensus.cc:686] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [term 1 LEADER]: Becoming Leader. State: Replica: 547076af8d344cce950a56878464322e, State: Running, Role: LEADER
I20260811 16:51:46.865063 3154 sys_catalog.cc:564] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:46.865173 3160 consensus_queue.cc:237] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547076af8d344cce950a56878464322e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41329 } }
I20260811 16:51:46.865604 3163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 547076af8d344cce950a56878464322e. Latest consensus state: current_term: 1 leader_uuid: "547076af8d344cce950a56878464322e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547076af8d344cce950a56878464322e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41329 } } }
I20260811 16:51:46.865756 3162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "547076af8d344cce950a56878464322e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "547076af8d344cce950a56878464322e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41329 } } }
I20260811 16:51:46.865761 3163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:46.865859 3162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:46.866127 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 3047
I20260811 16:51:46.866274 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:46.866499 2270 external_mini_cluster.cc:1428] Setting key dad8ebd5bb210903a47bb65838ba47ab
I20260811 16:51:46.866636 3175 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:46.867308 3175 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:46.869041 3175 catalog_manager.cc:1347] Generated new cluster ID: 2670737908b44b2c84cf144e87467a62
I20260811 16:51:46.869163 3175 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:46.872123 3189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:46.867125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.218:50475 (local address 127.0.0.1:41329)
0811 16:51:46.867386 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:46.867397 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:46.867432 (+ 35us) server_negotiation.cc:407] Connection header received
0811 16:51:46.867548 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:46.867553 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:46.867601 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:46.867761 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:46.867992 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:46.869153 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:46.869987 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:46.870507 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:46.870646 (+ 139us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:46.871444 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:46.871448 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:46.871449 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:46.871638 (+ 189us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:46.871671 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:46.871683 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:46.871781 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:46.871863 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 16:51:46.871897 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":85,"threads_started":1}
I20260811 16:51:46.873251 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:51:46.878226 3189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:46.874956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.218:54749 (local address 127.0.0.1:41329)
0811 16:51:46.874993 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:46.874995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:46.875004 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:51:46.875040 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:46.875041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:46.875052 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:46.875102 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:46.875220 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:46.876079 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:46.876861 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:46.877113 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:46.877197 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:46.877919 (+ 722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:46.877921 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:46.877922 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:46.877927 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:46.877945 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:46.877949 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:46.878045 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:46.878112 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 16:51:46.878134 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:51:46.895972 3175 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:46.896811 3175 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:46.900805 3175 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 547076af8d344cce950a56878464322e: Generated new TSK 0
I20260811 16:51:46.901051 3175 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:46.905435 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 3047
W20260811 16:51:46.927134 3021 connection.cc:535] client connection to 127.0.0.1:41329 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41329): Connection reset by peer (error 104)
2026-08-11T16:51:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1571 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:46 dist-test-slave-3h5h krb5kdc[3210](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:46 dist-test-slave-3h5h krb5kdc[3210](info): set up 2 sockets
Aug 11 16:51:46 dist-test-slave-3h5h krb5kdc[3210](info): commencing operation
krb5kdc: starting...
W20260811 16:51:48.186928 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.245s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:48 dist-test-slave-3h5h krb5kdc[3210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:51:48.326177 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34045
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34045
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:48.411036 3225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:48.411303 3225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:48.411343 3225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:48.412554 3225 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:48.412624 3225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:48.412648 3225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:48.412668 3225 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:48.412700 3225 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:48.414252 3225 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34045
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3225
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:48.414530 3225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:48.414759 3225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:51:48.419864 3225 server_base.cc:1034] running on GCE node
W20260811 16:51:48.419801 3232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:48.419821 3231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:48.419800 3235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:48.420317 3225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:48.420637 3225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:48.421811 3225 hybrid_clock.cc:648] HybridClock initialized: now 1786467108421795 us; error 55 us; skew 500 ppm
Aug 11 16:51:48 dist-test-slave-3h5h krb5kdc[3210](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467108, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:48.424280 3225 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:51:48.424777 3225 webserver.cc:460] Webserver started at http://127.0.0.1:39071/ using document root <none> and password file <none>
I20260811 16:51:48.425061 3225 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:48.425132 3225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:48.425292 3225 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:48.426362 3225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "d2e1cf3c08d54feda7db7495c16cfe8f"
format_stamp: "Formatted at 2026-08-11 16:51:48 on dist-test-slave-3h5h"
server_key: "38767c3d807f7820b7b6703c4859b11d"
server_key_iv: "2e5397d3bd771f3fd877d6155edb4f44"
server_key_version: "encryptionkey@0"
I20260811 16:51:48.426738 3225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "d2e1cf3c08d54feda7db7495c16cfe8f"
format_stamp: "Formatted at 2026-08-11 16:51:48 on dist-test-slave-3h5h"
server_key: "38767c3d807f7820b7b6703c4859b11d"
server_key_iv: "2e5397d3bd771f3fd877d6155edb4f44"
server_key_version: "encryptionkey@0"
I20260811 16:51:48.428061 3225 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:51:48.428771 3247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:48.428961 3225 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:51:48.429075 3225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "d2e1cf3c08d54feda7db7495c16cfe8f"
format_stamp: "Formatted at 2026-08-11 16:51:48 on dist-test-slave-3h5h"
server_key: "38767c3d807f7820b7b6703c4859b11d"
server_key_iv: "2e5397d3bd771f3fd877d6155edb4f44"
server_key_version: "encryptionkey@0"
I20260811 16:51:48.429160 3225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:48.432461 3225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:48.434780 3225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:48.434938 3225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:48.439095 3225 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34045
I20260811 16:51:48.439155 3330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34045 every 8 connection(s)
I20260811 16:51:48.439491 3225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:48.440480 3331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:48.442131 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 3225
I20260811 16:51:48.442246 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:48.442456 2270 external_mini_cluster.cc:1428] Setting key 125c5617aa55520a9d9c5a1662739b37
I20260811 16:51:48.443361 3331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f: Bootstrap starting.
I20260811 16:51:48.444043 3331 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:48.444433 3331 log.cc:824] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:48.445039 3335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:48.442994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.218:44743 (local address 127.0.0.1:34045)
0811 16:51:48.443221 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:48.443229 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:48.443254 (+ 25us) server_negotiation.cc:407] Connection header received
0811 16:51:48.443703 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:48.443710 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:48.443735 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:48.443853 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:48.444505 (+ 652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:48.444508 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:48.444508 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:48.444512 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:48.444571 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:48.444587 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:48.444692 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:48.444755 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 16:51:48.444798 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":122,"threads_started":1}
I20260811 16:51:48.445300 3331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f: No bootstrap required, opened a new log
I20260811 16:51:48.446120 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:51:48.447898 3331 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e1cf3c08d54feda7db7495c16cfe8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34045 } }
I20260811 16:51:48.448097 3331 raft_consensus.cc:374] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:48.448137 3331 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e1cf3c08d54feda7db7495c16cfe8f, State: Initialized, Role: FOLLOWER
I20260811 16:51:48.448282 3331 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e1cf3c08d54feda7db7495c16cfe8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34045 } }
I20260811 16:51:48.448391 3331 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:48.448438 3331 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:48.448485 3331 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:48.448850 3335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:48.447749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.218:58647 (local address 127.0.0.1:34045)
0811 16:51:48.447813 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:48.447815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:48.447970 (+ 155us) server_negotiation.cc:407] Connection header received
0811 16:51:48.447992 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:48.447992 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:48.447997 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:48.448056 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:48.448633 (+ 577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:48.448635 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:48.448635 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:48.448640 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:48.448654 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:48.448665 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:48.448731 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:48.448766 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 16:51:48.448779 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:51:48.449270 3331 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e1cf3c08d54feda7db7495c16cfe8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34045 } }
I20260811 16:51:48.449375 3331 leader_election.cc:302] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2e1cf3c08d54feda7db7495c16cfe8f; no voters:
I20260811 16:51:48.449537 3331 leader_election.cc:288] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:48.449620 3346 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:48.449775 3346 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [term 1 LEADER]: Becoming Leader. State: Replica: d2e1cf3c08d54feda7db7495c16cfe8f, State: Running, Role: LEADER
I20260811 16:51:48.449792 3331 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:48.449911 3346 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e1cf3c08d54feda7db7495c16cfe8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34045 } }
I20260811 16:51:48.450356 3348 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2e1cf3c08d54feda7db7495c16cfe8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e1cf3c08d54feda7db7495c16cfe8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34045 } } }
I20260811 16:51:48.450364 3349 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2e1cf3c08d54feda7db7495c16cfe8f. Latest consensus state: current_term: 1 leader_uuid: "d2e1cf3c08d54feda7db7495c16cfe8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e1cf3c08d54feda7db7495c16cfe8f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34045 } } }
I20260811 16:51:48.450553 3348 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:48.450564 3349 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:48.451659 3358 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:48.452149 3358 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:48.453723 3358 catalog_manager.cc:1347] Generated new cluster ID: be7af57bc14e4e6086956c3fec797d99
I20260811 16:51:48.453766 3358 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:48.463389 3358 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:48.463615 3358 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:48.472462 3358 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d2e1cf3c08d54feda7db7495c16cfe8f: Generated new TSK 0
I20260811 16:51:48.472735 3358 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:48.476378 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 3225
2026-08-11T16:51:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1565 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:48 dist-test-slave-3h5h krb5kdc[3375](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:48 dist-test-slave-3h5h krb5kdc[3375](info): set up 2 sockets
Aug 11 16:51:48 dist-test-slave-3h5h krb5kdc[3375](info): commencing operation
krb5kdc: starting...
W20260811 16:51:49.791332 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.284s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:49 dist-test-slave-3h5h krb5kdc[3375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:51:49.928336 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36079
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36079
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:50.017475 3396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:50.017730 3396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:50.017771 3396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:50.018941 3396 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:50.019019 3396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:50.019045 3396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:50.019070 3396 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:50.019101 3396 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:50.020629 3396 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36079
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:50.020946 3396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:50.021292 3396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:50.026319 3404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:50.026329 3406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:50.026547 3396 server_base.cc:1034] running on GCE node
W20260811 16:51:50.026329 3408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:50.026901 3396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:50.027257 3396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:50.028450 3396 hybrid_clock.cc:648] HybridClock initialized: now 1786467110028444 us; error 36 us; skew 500 ppm
Aug 11 16:51:50 dist-test-slave-3h5h krb5kdc[3375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467110, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:50.031105 3396 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:51:50.031528 3396 webserver.cc:460] Webserver started at http://127.0.0.1:36839/ using document root <none> and password file <none>
I20260811 16:51:50.031791 3396 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:50.031840 3396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:50.031981 3396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:50.033143 3396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "676c00acf929452c9de919aad0cd9cff"
format_stamp: "Formatted at 2026-08-11 16:51:50 on dist-test-slave-3h5h"
server_key: "76faf3f3017af7b52d3587f53729252a"
server_key_iv: "0b164452ff296a01b95f6daac3c9b648"
server_key_version: "encryptionkey@0"
I20260811 16:51:50.033517 3396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "676c00acf929452c9de919aad0cd9cff"
format_stamp: "Formatted at 2026-08-11 16:51:50 on dist-test-slave-3h5h"
server_key: "76faf3f3017af7b52d3587f53729252a"
server_key_iv: "0b164452ff296a01b95f6daac3c9b648"
server_key_version: "encryptionkey@0"
I20260811 16:51:50.034998 3396 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 16:51:50.035799 3427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:50.036000 3396 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:50.036098 3396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "676c00acf929452c9de919aad0cd9cff"
format_stamp: "Formatted at 2026-08-11 16:51:50 on dist-test-slave-3h5h"
server_key: "76faf3f3017af7b52d3587f53729252a"
server_key_iv: "0b164452ff296a01b95f6daac3c9b648"
server_key_version: "encryptionkey@0"
I20260811 16:51:50.036194 3396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:50.052578 3396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:50.054895 3396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:50.055069 3396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:50.059553 3396 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36079
I20260811 16:51:50.059602 3502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36079 every 8 connection(s)
I20260811 16:51:50.059988 3396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:50.061178 3506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:50.063593 3506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff: Bootstrap starting.
I20260811 16:51:50.064225 3506 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:50.064533 3506 log.cc:824] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:50.064531 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 3396
I20260811 16:51:50.064710 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:50.064967 2270 external_mini_cluster.cc:1428] Setting key 5cd0d9d92b50dd9f071faddf1d030f00
I20260811 16:51:50.065325 3506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff: No bootstrap required, opened a new log
I20260811 16:51:50.067188 3506 raft_consensus.cc:348] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "676c00acf929452c9de919aad0cd9cff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36079 } }
I20260811 16:51:50.067353 3506 raft_consensus.cc:374] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:50.067395 3506 raft_consensus.cc:729] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 676c00acf929452c9de919aad0cd9cff, State: Initialized, Role: FOLLOWER
I20260811 16:51:50.067590 3506 consensus_queue.cc:260] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "676c00acf929452c9de919aad0cd9cff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36079 } }
I20260811 16:51:50.067694 3506 raft_consensus.cc:388] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:50.067728 3506 raft_consensus.cc:482] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:50.067772 3506 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:50.068771 3506 raft_consensus.cc:504] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "676c00acf929452c9de919aad0cd9cff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36079 } }
I20260811 16:51:50.068923 3506 leader_election.cc:302] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 676c00acf929452c9de919aad0cd9cff; no voters:
I20260811 16:51:50.069157 3506 leader_election.cc:288] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:50.069181 3518 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:50.069299 3518 raft_consensus.cc:686] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [term 1 LEADER]: Becoming Leader. State: Replica: 676c00acf929452c9de919aad0cd9cff, State: Running, Role: LEADER
I20260811 16:51:50.069439 3506 sys_catalog.cc:564] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:50.069444 3518 consensus_queue.cc:237] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "676c00acf929452c9de919aad0cd9cff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36079 } }
I20260811 16:51:50.069926 3523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 676c00acf929452c9de919aad0cd9cff. Latest consensus state: current_term: 1 leader_uuid: "676c00acf929452c9de919aad0cd9cff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "676c00acf929452c9de919aad0cd9cff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36079 } } }
I20260811 16:51:50.070020 3523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:50.070252 3520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "676c00acf929452c9de919aad0cd9cff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "676c00acf929452c9de919aad0cd9cff" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36079 } } }
I20260811 16:51:50.070379 3520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:50.070783 3535 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:50.071607 3535 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:50.073541 3535 catalog_manager.cc:1347] Generated new cluster ID: af6b621c453f40ab9babda78c4b06885
I20260811 16:51:50.073611 3535 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:51:50 dist-test-slave-3h5h krb5kdc[3375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 16:51:50.079078 3514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:50.065530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.218:56773 (local address 127.0.0.1:36079)
0811 16:51:50.065724 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:50.065739 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:50.065766 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:51:50.067168 (+ 1402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:50.067175 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:50.067232 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:50.067368 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:50.068250 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:50.069322 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:50.070443 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:50.071277 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:50.071820 (+ 543us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:50.075214 (+ 3394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:50.075219 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:50.075219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:50.075239 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:50.077261 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:50.077719 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:50.077725 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:50.077725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:50.077849 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:50.078147 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:50.078148 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:50.078148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:50.078424 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:50.078643 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:50.078739 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 16:51:50.078853 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":129,"thread_start_us":97,"threads_started":1}
I20260811 16:51:50.080256 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:51:50.082648 3535 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:50.083240 3535 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:50.090858 3514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:50.081947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.218:52751 (local address 127.0.0.1:36079)
0811 16:51:50.081999 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:50.082001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:50.082160 (+ 159us) server_negotiation.cc:407] Connection header received
0811 16:51:50.082257 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:50.082258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:50.082274 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:50.082358 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:50.083247 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:50.084052 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:50.085216 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:50.085585 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:50.085657 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:50.087496 (+ 1839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:50.087497 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:50.087497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:50.087505 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:50.089383 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:50.089890 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:50.089891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:50.089892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:50.089955 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:50.090240 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:50.090241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:50.090241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:50.090374 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:50.090484 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:50.090687 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 16:51:50.090755 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:51:50.092465 3535 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 676c00acf929452c9de919aad0cd9cff: Generated new TSK 0
I20260811 16:51:50.092705 3535 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:50.099126 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 3396
W20260811 16:51:50.110265 3373 connection.cc:535] client connection to 127.0.0.1:36079 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36079): Connection reset by peer (error 104)
2026-08-11T16:51:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1617 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:50 dist-test-slave-3h5h krb5kdc[3564](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:50 dist-test-slave-3h5h krb5kdc[3564](info): set up 2 sockets
Aug 11 16:51:50 dist-test-slave-3h5h krb5kdc[3564](info): commencing operation
krb5kdc: starting...
W20260811 16:51:51.390625 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:51 dist-test-slave-3h5h krb5kdc[3564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:51:51.528749 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39433
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39433
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:51.615294 3585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:51.615509 3585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:51.615531 3585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:51.616622 3585 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:51.616659 3585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:51.616673 3585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:51.616685 3585 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:51.616698 3585 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:51.618232 3585 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39433
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:51.618440 3585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:51.618623 3585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:51.623975 3593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:51.623970 3596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:51.623970 3592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:51.624217 3585 server_base.cc:1034] running on GCE node
I20260811 16:51:51.624457 3585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:51.624802 3585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:51.626003 3585 hybrid_clock.cc:648] HybridClock initialized: now 1786467111625975 us; error 43 us; skew 500 ppm
Aug 11 16:51:51 dist-test-slave-3h5h krb5kdc[3564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467111, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:51.634577 3585 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:51:51.635183 3585 webserver.cc:460] Webserver started at http://127.0.0.1:39245/ using document root <none> and password file <none>
I20260811 16:51:51.635427 3585 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:51.635494 3585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:51.635635 3585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:51.636730 3585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "8ac48aff8d4a4243a5916356f9f07fe2"
format_stamp: "Formatted at 2026-08-11 16:51:51 on dist-test-slave-3h5h"
server_key: "509e872ca0f7c217d8fc62628684bf40"
server_key_iv: "b7e9291085aa45353177288b728518cc"
server_key_version: "encryptionkey@0"
I20260811 16:51:51.637146 3585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "8ac48aff8d4a4243a5916356f9f07fe2"
format_stamp: "Formatted at 2026-08-11 16:51:51 on dist-test-slave-3h5h"
server_key: "509e872ca0f7c217d8fc62628684bf40"
server_key_iv: "b7e9291085aa45353177288b728518cc"
server_key_version: "encryptionkey@0"
I20260811 16:51:51.638536 3585 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:51.639377 3610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:51.639595 3585 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:51.639734 3585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "8ac48aff8d4a4243a5916356f9f07fe2"
format_stamp: "Formatted at 2026-08-11 16:51:51 on dist-test-slave-3h5h"
server_key: "509e872ca0f7c217d8fc62628684bf40"
server_key_iv: "b7e9291085aa45353177288b728518cc"
server_key_version: "encryptionkey@0"
I20260811 16:51:51.639813 3585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:51.675633 3585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:51.678072 3585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:51.678277 3585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:51.682546 3585 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39433
I20260811 16:51:51.682588 3697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39433 every 8 connection(s)
I20260811 16:51:51.682997 3585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:51.683923 3699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:51.685057 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 3585
I20260811 16:51:51.685181 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:51.685374 2270 external_mini_cluster.cc:1428] Setting key 7ab4ad068adde83df2d64848acae956a
I20260811 16:51:51.687731 3699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2: Bootstrap starting.
I20260811 16:51:51.688517 3699 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:51.688871 3699 log.cc:824] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:51.689640 3699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2: No bootstrap required, opened a new log
I20260811 16:51:51.692261 3705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:51.685934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.218:43975 (local address 127.0.0.1:39433)
0811 16:51:51.686227 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:51.686237 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:51.686270 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:51:51.686794 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:51.686803 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:51.686874 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:51.687025 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:51.687308 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:51.688763 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:51.689859 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:51.690458 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:51.690590 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:51.691444 (+ 854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:51.691449 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:51.691449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:51.691686 (+ 237us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:51.691735 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:51.691754 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:51.691864 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:51.691984 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 16:51:51.692018 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":172,"threads_started":1}
I20260811 16:51:51.692435 3699 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac48aff8d4a4243a5916356f9f07fe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39433 } }
I20260811 16:51:51.692610 3699 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:51.692646 3699 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ac48aff8d4a4243a5916356f9f07fe2, State: Initialized, Role: FOLLOWER
I20260811 16:51:51.692773 3699 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac48aff8d4a4243a5916356f9f07fe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39433 } }
I20260811 16:51:51.692915 3699 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:51.692965 3699 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:51.693030 3699 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:51.693471 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:51:51.693800 3699 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac48aff8d4a4243a5916356f9f07fe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39433 } }
I20260811 16:51:51.693925 3699 leader_election.cc:302] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ac48aff8d4a4243a5916356f9f07fe2; no voters:
I20260811 16:51:51.694123 3699 leader_election.cc:288] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:51.694168 3707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:51.694285 3707 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [term 1 LEADER]: Becoming Leader. State: Replica: 8ac48aff8d4a4243a5916356f9f07fe2, State: Running, Role: LEADER
I20260811 16:51:51.694414 3699 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:51.694428 3707 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac48aff8d4a4243a5916356f9f07fe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39433 } }
I20260811 16:51:51.694854 3708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ac48aff8d4a4243a5916356f9f07fe2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac48aff8d4a4243a5916356f9f07fe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39433 } } }
I20260811 16:51:51.694954 3708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:51.694837 3707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ac48aff8d4a4243a5916356f9f07fe2. Latest consensus state: current_term: 1 leader_uuid: "8ac48aff8d4a4243a5916356f9f07fe2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac48aff8d4a4243a5916356f9f07fe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39433 } } }
I20260811 16:51:51.695290 3707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:51.695437 3725 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:51.695999 3725 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:51.697760 3725 catalog_manager.cc:1347] Generated new cluster ID: f1a5c16fbf164f63a18347e8d89e732f
I20260811 16:51:51.697825 3725 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:51.700300 3705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:51.695069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.218:47295 (local address 127.0.0.1:39433)
0811 16:51:51.695108 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:51.695110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:51.696673 (+ 1563us) server_negotiation.cc:407] Connection header received
0811 16:51:51.696874 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:51.696875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:51.696886 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:51.696918 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:51.697155 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:51.697881 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:51.698898 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:51.699217 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:51.699293 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:51.700042 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:51.700043 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:51.700044 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:51.700048 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:51.700065 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:51.700070 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:51.700129 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:51.700211 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 16:51:51.700224 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:51:51.706144 3725 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:51.706862 3725 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:51.716447 3725 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ac48aff8d4a4243a5916356f9f07fe2: Generated new TSK 0
I20260811 16:51:51.716665 3725 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:51.720239 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 3585
W20260811 16:51:51.734977 3562 connection.cc:535] client connection to 127.0.0.1:39433 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39433): Connection reset by peer (error 104)
2026-08-11T16:51:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1624 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:51 dist-test-slave-3h5h krb5kdc[3750](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:51 dist-test-slave-3h5h krb5kdc[3750](info): set up 2 sockets
Aug 11 16:51:51 dist-test-slave-3h5h krb5kdc[3750](info): commencing operation
krb5kdc: starting...
W20260811 16:51:53.049230 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.300s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:53 dist-test-slave-3h5h krb5kdc[3750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:51:53.183928 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37103
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37103
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:53.268354 3768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:53.268577 3768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:53.268606 3768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:53.269940 3768 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:53.269989 3768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:53.270004 3768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:53.270016 3768 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:53.270028 3768 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:53.271476 3768 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37103
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37103
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:53.271684 3768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:53.271857 3768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:53.276916 3777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:53.277069 3768 server_base.cc:1034] running on GCE node
W20260811 16:51:53.276922 3778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:53.277230 3780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:53.277482 3768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:53.277781 3768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:53.278918 3768 hybrid_clock.cc:648] HybridClock initialized: now 1786467113278909 us; error 43 us; skew 500 ppm
Aug 11 16:51:53 dist-test-slave-3h5h krb5kdc[3750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467113, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:53.281436 3768 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:51:53.281821 3768 webserver.cc:460] Webserver started at http://127.0.0.1:33413/ using document root <none> and password file <none>
I20260811 16:51:53.282003 3768 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:53.282047 3768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:53.282145 3768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:53.283172 3768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "b3f8ec9f385441aa91a7a1c70b7a469d"
format_stamp: "Formatted at 2026-08-11 16:51:53 on dist-test-slave-3h5h"
server_key: "79bc34509219111de1b03d49b5fa571b"
server_key_iv: "bb50a14a8d8dd94abc92199d6ac2bc86"
server_key_version: "encryptionkey@0"
I20260811 16:51:53.283479 3768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "b3f8ec9f385441aa91a7a1c70b7a469d"
format_stamp: "Formatted at 2026-08-11 16:51:53 on dist-test-slave-3h5h"
server_key: "79bc34509219111de1b03d49b5fa571b"
server_key_iv: "bb50a14a8d8dd94abc92199d6ac2bc86"
server_key_version: "encryptionkey@0"
I20260811 16:51:53.284821 3768 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:51:53.285691 3789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:53.285887 3768 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:51:53.285987 3768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "b3f8ec9f385441aa91a7a1c70b7a469d"
format_stamp: "Formatted at 2026-08-11 16:51:53 on dist-test-slave-3h5h"
server_key: "79bc34509219111de1b03d49b5fa571b"
server_key_iv: "bb50a14a8d8dd94abc92199d6ac2bc86"
server_key_version: "encryptionkey@0"
I20260811 16:51:53.286067 3768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:53.290005 3768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:53.291951 3768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:53.292112 3768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:53.296772 3768 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37103
I20260811 16:51:53.296881 3877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37103 every 8 connection(s)
I20260811 16:51:53.297562 3768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:53.298895 3878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:53.299413 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 3768
I20260811 16:51:53.299576 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:53.299793 2270 external_mini_cluster.cc:1428] Setting key 53961e7ab8333b37cb9a17639fd07d31
I20260811 16:51:53.303257 3878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d: Bootstrap starting.
I20260811 16:51:53.303684 3882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:53.300479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.218:55893 (local address 127.0.0.1:37103)
0811 16:51:53.300741 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:53.300753 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:53.301126 (+ 373us) server_negotiation.cc:407] Connection header received
0811 16:51:53.301621 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:53.301655 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:53.301689 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:53.301841 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:53.303039 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:53.303043 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:53.303043 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:53.303048 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:53.303129 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:53.303174 (+ 45us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:53.303298 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:53.303423 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 16:51:53.303479 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":104,"threads_started":1}
I20260811 16:51:53.304169 3878 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:53.304523 3878 log.cc:824] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:53.305459 3878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d: No bootstrap required, opened a new log
I20260811 16:51:53.307412 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:51:53.308252 3878 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f8ec9f385441aa91a7a1c70b7a469d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37103 } }
I20260811 16:51:53.308434 3878 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:53.308466 3878 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3f8ec9f385441aa91a7a1c70b7a469d, State: Initialized, Role: FOLLOWER
I20260811 16:51:53.308598 3878 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f8ec9f385441aa91a7a1c70b7a469d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37103 } }
I20260811 16:51:53.308701 3878 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:53.308743 3878 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:53.308796 3878 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:53.309612 3878 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f8ec9f385441aa91a7a1c70b7a469d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37103 } }
I20260811 16:51:53.309731 3878 leader_election.cc:302] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3f8ec9f385441aa91a7a1c70b7a469d; no voters:
I20260811 16:51:53.309914 3878 leader_election.cc:288] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:53.309990 3892 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:53.310181 3892 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [term 1 LEADER]: Becoming Leader. State: Replica: b3f8ec9f385441aa91a7a1c70b7a469d, State: Running, Role: LEADER
I20260811 16:51:53.310197 3878 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:53.310331 3892 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f8ec9f385441aa91a7a1c70b7a469d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37103 } }
I20260811 16:51:53.310738 3882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:53.309334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.218:45809 (local address 127.0.0.1:37103)
0811 16:51:53.309376 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:53.309378 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:53.309567 (+ 189us) server_negotiation.cc:407] Connection header received
0811 16:51:53.309594 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:53.309595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:53.309601 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:53.309664 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:53.310410 (+ 746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:53.310412 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:53.310413 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:53.310418 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:53.310435 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:53.310440 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:53.310491 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:53.310652 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 16:51:53.310669 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:51:53.310794 3899 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3f8ec9f385441aa91a7a1c70b7a469d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f8ec9f385441aa91a7a1c70b7a469d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37103 } } }
I20260811 16:51:53.310899 3899 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:53.311116 3894 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3f8ec9f385441aa91a7a1c70b7a469d. Latest consensus state: current_term: 1 leader_uuid: "b3f8ec9f385441aa91a7a1c70b7a469d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3f8ec9f385441aa91a7a1c70b7a469d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37103 } } }
I20260811 16:51:53.311213 3894 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:53.311583 3909 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:53.312218 3909 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:53.313898 3909 catalog_manager.cc:1347] Generated new cluster ID: 851a23daf79c454380ac9babfb88168d
I20260811 16:51:53.313951 3909 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:53.329883 3909 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:53.330160 3909 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:53.341776 3909 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3f8ec9f385441aa91a7a1c70b7a469d: Generated new TSK 0
I20260811 16:51:53.342113 3909 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:53.347692 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 3768
2026-08-11T16:51:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1626 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:53 dist-test-slave-3h5h krb5kdc[3928](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:53 dist-test-slave-3h5h krb5kdc[3928](info): set up 2 sockets
Aug 11 16:51:53 dist-test-slave-3h5h krb5kdc[3928](info): commencing operation
krb5kdc: starting...
W20260811 16:51:54.640697 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.265s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:54 dist-test-slave-3h5h krb5kdc[3928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:51:54.767872 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:45429
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:40135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:45429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:54.853785 3946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:54.853998 3946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:54.854022 3946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:54.855180 3946 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:54.855224 3946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:54.855238 3946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:54.855252 3946 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:54.855300 3946 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:54.856864 3946 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:40135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:45429
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:45429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:54.857134 3946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:54.857363 3946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:54.863705 3955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:54.863848 3954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:54.863696 3957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:54.864015 3946 server_base.cc:1034] running on GCE node
I20260811 16:51:54.864349 3946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:54.864712 3946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:54.865867 3946 hybrid_clock.cc:648] HybridClock initialized: now 1786467114865846 us; error 38 us; skew 500 ppm
Aug 11 16:51:54 dist-test-slave-3h5h krb5kdc[3928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467114, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:54.870766 3946 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:51:54.871326 3946 webserver.cc:460] Webserver started at http://127.2.55.190:42217/ using document root <none> and password file <none>
I20260811 16:51:54.871587 3946 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:54.871663 3946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:54.871821 3946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:54.873065 3946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "990161ccf3c9430f9af3421ff7a6b72e"
format_stamp: "Formatted at 2026-08-11 16:51:54 on dist-test-slave-3h5h"
server_key: "58648472cd1de17827daf36893e93658"
server_key_iv: "79abcb1e5c69ee10afe92a092f5f4a04"
server_key_version: "encryptionkey@0"
I20260811 16:51:54.873494 3946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "990161ccf3c9430f9af3421ff7a6b72e"
format_stamp: "Formatted at 2026-08-11 16:51:54 on dist-test-slave-3h5h"
server_key: "58648472cd1de17827daf36893e93658"
server_key_iv: "79abcb1e5c69ee10afe92a092f5f4a04"
server_key_version: "encryptionkey@0"
I20260811 16:51:54.875546 3946 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 16:51:54.876382 3966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:54.876595 3946 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:54.876701 3946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "990161ccf3c9430f9af3421ff7a6b72e"
format_stamp: "Formatted at 2026-08-11 16:51:54 on dist-test-slave-3h5h"
server_key: "58648472cd1de17827daf36893e93658"
server_key_iv: "79abcb1e5c69ee10afe92a092f5f4a04"
server_key_version: "encryptionkey@0"
I20260811 16:51:54.876791 3946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:54.893970 3946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:54.896448 3946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:54.896623 3946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:54.901226 3946 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:45429
I20260811 16:51:54.901268 4049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:45429 every 8 connection(s)
I20260811 16:51:54.901715 3946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:54.902673 4052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:54.903838 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 3946
I20260811 16:51:54.903965 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:54.904179 2270 external_mini_cluster.cc:1428] Setting key 724eae58e737cb520df0d942b9c31c72
I20260811 16:51:54.905629 4052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e: Bootstrap starting.
I20260811 16:51:54.906396 4052 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:54.906733 4052 log.cc:824] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:54.907470 4052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e: No bootstrap required, opened a new log
I20260811 16:51:54.910037 4052 raft_consensus.cc:348] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "990161ccf3c9430f9af3421ff7a6b72e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45429 } }
I20260811 16:51:54.910235 4052 raft_consensus.cc:374] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:54.910280 4052 raft_consensus.cc:729] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 990161ccf3c9430f9af3421ff7a6b72e, State: Initialized, Role: FOLLOWER
I20260811 16:51:54.910432 4052 consensus_queue.cc:260] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "990161ccf3c9430f9af3421ff7a6b72e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45429 } }
I20260811 16:51:54.910526 4052 raft_consensus.cc:388] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:54.910564 4052 raft_consensus.cc:482] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:54.910619 4052 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:54.911268 4052 raft_consensus.cc:504] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "990161ccf3c9430f9af3421ff7a6b72e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45429 } }
I20260811 16:51:54.911360 4052 leader_election.cc:302] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 990161ccf3c9430f9af3421ff7a6b72e; no voters:
Aug 11 16:51:54 dist-test-slave-3h5h krb5kdc[3928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:51:54.911573 4052 leader_election.cc:288] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:54.911605 4061 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:54.911760 4061 raft_consensus.cc:686] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [term 1 LEADER]: Becoming Leader. State: Replica: 990161ccf3c9430f9af3421ff7a6b72e, State: Running, Role: LEADER
I20260811 16:51:54.911862 4061 consensus_queue.cc:237] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "990161ccf3c9430f9af3421ff7a6b72e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45429 } }
I20260811 16:51:54.911866 4052 sys_catalog.cc:564] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:54.912263 4064 sys_catalog.cc:455] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "990161ccf3c9430f9af3421ff7a6b72e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "990161ccf3c9430f9af3421ff7a6b72e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45429 } } }
I20260811 16:51:54.912384 4064 sys_catalog.cc:458] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:54.912253 4061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 990161ccf3c9430f9af3421ff7a6b72e. Latest consensus state: current_term: 1 leader_uuid: "990161ccf3c9430f9af3421ff7a6b72e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "990161ccf3c9430f9af3421ff7a6b72e" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45429 } } }
I20260811 16:51:54.912703 4061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:54.912792 4073 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:54.913403 4073 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:54.915148 4073 catalog_manager.cc:1347] Generated new cluster ID: 27aa8f5263f5480194526800bb48ba00
I20260811 16:51:54.915195 4073 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:54.916123 4056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:54.904725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43683 (local address 127.2.55.190:45429)
0811 16:51:54.904924 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:54.904932 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:54.904958 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:51:54.905424 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:54.905432 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:54.905479 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:54.905611 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:54.906434 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:54.907594 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:54.908634 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:54.909125 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:54.909207 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:54.912073 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:54.912078 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:54.912079 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:54.912106 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:54.914258 (+ 2152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:54.914721 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:54.914724 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:54.914725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:54.914835 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:54.915123 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:54.915124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:54.915125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:54.915429 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:54.915573 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:54.915808 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 16:51:54.915903 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":93,"threads_started":1}
I20260811 16:51:54.917225 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:51:54.924286 4073 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:54.925004 4073 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:54.928480 4056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:54.920944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42325 (local address 127.2.55.190:45429)
0811 16:51:54.920985 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:54.920987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:54.921234 (+ 247us) server_negotiation.cc:407] Connection header received
0811 16:51:54.921292 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:54.921293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:54.921303 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:54.921359 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:54.922008 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:54.922828 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:54.923838 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:54.924134 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:54.924206 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:54.925781 (+ 1575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:54.925783 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:54.925783 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:54.925790 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:54.927295 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:54.927693 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:54.927694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:54.927694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:54.927744 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:54.927944 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:54.927945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:54.927945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:54.928049 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:54.928127 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:54.928332 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 16:51:54.928392 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:51:54.932014 4073 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 990161ccf3c9430f9af3421ff7a6b72e: Generated new TSK 0
I20260811 16:51:54.932201 4073 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:54.934266 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 3946
W20260811 16:51:54.950053 3925 connection.cc:535] client connection to 127.2.55.190:45429 recv error: Network error: failed to read from TLS socket (remote: 127.2.55.190:45429): Connection reset by peer (error 104)
2026-08-11T16:51:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1588 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:55 dist-test-slave-3h5h krb5kdc[4099](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:55 dist-test-slave-3h5h krb5kdc[4099](info): set up 2 sockets
Aug 11 16:51:55 dist-test-slave-3h5h krb5kdc[4099](info): commencing operation
krb5kdc: starting...
W20260811 16:51:56.227232 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:56 dist-test-slave-3h5h krb5kdc[4099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:51:56.360785 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:42327
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:34701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:42327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:56.445217 4117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:56.445462 4117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:56.445500 4117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:56.446633 4117 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:56.446702 4117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:56.446727 4117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:56.446758 4117 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:56.446799 4117 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:56.448340 4117 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:34701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:42327
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:42327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:56.448632 4117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:56.448892 4117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:56.453917 4134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:56.453910 4128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:56.453966 4126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:56.454263 4117 server_base.cc:1034] running on GCE node
I20260811 16:51:56.454484 4117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:56.454778 4117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:56.455920 4117 hybrid_clock.cc:648] HybridClock initialized: now 1786467116455907 us; error 29 us; skew 500 ppm
Aug 11 16:51:56 dist-test-slave-3h5h krb5kdc[4099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467116, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:56.458748 4117 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:51:56.459302 4117 webserver.cc:460] Webserver started at http://127.2.55.190:38467/ using document root <none> and password file <none>
I20260811 16:51:56.459570 4117 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:56.459623 4117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:56.459797 4117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:56.461028 4117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "0fd407a9173c4f3b9b9e39ce6e67045f"
format_stamp: "Formatted at 2026-08-11 16:51:56 on dist-test-slave-3h5h"
server_key: "63d51801f39c18f9d0661c66dcffccfb"
server_key_iv: "d0ea20b02f866c3abcafcc8705f840d2"
server_key_version: "encryptionkey@0"
I20260811 16:51:56.461414 4117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "0fd407a9173c4f3b9b9e39ce6e67045f"
format_stamp: "Formatted at 2026-08-11 16:51:56 on dist-test-slave-3h5h"
server_key: "63d51801f39c18f9d0661c66dcffccfb"
server_key_iv: "d0ea20b02f866c3abcafcc8705f840d2"
server_key_version: "encryptionkey@0"
I20260811 16:51:56.463027 4117 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:51:56.464047 4144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:56.464291 4117 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:51:56.464422 4117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "0fd407a9173c4f3b9b9e39ce6e67045f"
format_stamp: "Formatted at 2026-08-11 16:51:56 on dist-test-slave-3h5h"
server_key: "63d51801f39c18f9d0661c66dcffccfb"
server_key_iv: "d0ea20b02f866c3abcafcc8705f840d2"
server_key_version: "encryptionkey@0"
I20260811 16:51:56.464510 4117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:56.479115 4117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:56.481405 4117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:56.481604 4117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:56.486550 4117 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:42327
I20260811 16:51:56.486644 4223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:42327 every 8 connection(s)
I20260811 16:51:56.487053 4117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:56.488013 4224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:56.490489 4224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f: Bootstrap starting.
I20260811 16:51:56.491110 4224 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:56.491410 4224 log.cc:824] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:56.492177 4224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f: No bootstrap required, opened a new log
I20260811 16:51:56.493880 4224 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fd407a9173c4f3b9b9e39ce6e67045f" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42327 } }
I20260811 16:51:56.494027 4224 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:56.494051 4224 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fd407a9173c4f3b9b9e39ce6e67045f, State: Initialized, Role: FOLLOWER
I20260811 16:51:56.494208 4224 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fd407a9173c4f3b9b9e39ce6e67045f" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42327 } }
I20260811 16:51:56.494275 4224 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:56.494297 4224 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:56.494325 4224 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:56.495208 4224 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fd407a9173c4f3b9b9e39ce6e67045f" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42327 } }
I20260811 16:51:56.495303 4224 leader_election.cc:302] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fd407a9173c4f3b9b9e39ce6e67045f; no voters:
I20260811 16:51:56.495486 4224 leader_election.cc:288] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:56.495611 4227 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:56.495785 4224 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:56.495807 4227 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [term 1 LEADER]: Becoming Leader. State: Replica: 0fd407a9173c4f3b9b9e39ce6e67045f, State: Running, Role: LEADER
I20260811 16:51:56.495927 4227 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fd407a9173c4f3b9b9e39ce6e67045f" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42327 } }
I20260811 16:51:56.496356 4231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fd407a9173c4f3b9b9e39ce6e67045f. Latest consensus state: current_term: 1 leader_uuid: "0fd407a9173c4f3b9b9e39ce6e67045f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fd407a9173c4f3b9b9e39ce6e67045f" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42327 } } }
I20260811 16:51:56.496461 4231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:56.496678 4230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fd407a9173c4f3b9b9e39ce6e67045f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fd407a9173c4f3b9b9e39ce6e67045f" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42327 } } }
I20260811 16:51:56.496742 4238 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:56.497105 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 4117
I20260811 16:51:56.496752 4230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:56.497256 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:56.497491 2270 external_mini_cluster.cc:1428] Setting key 49ff322bd9b632d3fa4c364cf6d5e6d1
I20260811 16:51:56.497710 4238 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:56.499581 4238 catalog_manager.cc:1347] Generated new cluster ID: c9b2b6e22bfd47f1946e048024ecd41f
I20260811 16:51:56.499639 4238 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:56.503674 4252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:56.498159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46141 (local address 127.2.55.190:42327)
0811 16:51:56.498492 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:56.498502 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:56.498536 (+ 34us) server_negotiation.cc:407] Connection header received
0811 16:51:56.498658 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:56.498665 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:56.498724 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:56.498860 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:56.499304 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:56.500445 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:56.501394 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:56.501872 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:56.502014 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:56.502886 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:56.502891 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:56.502891 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:56.503098 (+ 207us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:56.503132 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:56.503151 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:56.503252 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:56.503343 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 16:51:56.503375 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":92,"threads_started":1}
I20260811 16:51:56.504954 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:51:56.508381 4238 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:56.509105 4238 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:56.511699 4238 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fd407a9173c4f3b9b9e39ce6e67045f: Generated new TSK 0
I20260811 16:51:56.511868 4238 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:56.513160 4252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:56.506551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39325 (local address 127.2.55.190:42327)
0811 16:51:56.506609 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:56.506612 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:56.509056 (+ 2444us) server_negotiation.cc:407] Connection header received
0811 16:51:56.509090 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:56.509091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:56.509107 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:56.509195 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:56.509363 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:56.510259 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:56.511393 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:56.511770 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:56.511856 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:56.512737 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:56.512738 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:56.512739 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:56.512744 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:56.512762 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:56.512767 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:56.512876 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:56.513085 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 16:51:56.513102 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:51:56.515316 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 4117
W20260811 16:51:56.533600 4097 connection.cc:535] client connection to 127.2.55.190:42327 recv error: Network error: failed to read from TLS socket (remote: 127.2.55.190:42327): Connection reset by peer (error 104)
2026-08-11T16:51:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1583 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:56 dist-test-slave-3h5h krb5kdc[4269](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:56 dist-test-slave-3h5h krb5kdc[4269](info): set up 2 sockets
Aug 11 16:51:56 dist-test-slave-3h5h krb5kdc[4269](info): commencing operation
krb5kdc: starting...
W20260811 16:51:57.864578 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.317s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:57 dist-test-slave-3h5h krb5kdc[4269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:51:58.000325 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:37119
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:35015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:37119
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:58.088549 4292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:58.088783 4292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:58.088809 4292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:58.089960 4292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:58.090004 4292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:58.090025 4292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:58.090039 4292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:58.090050 4292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:58.091545 4292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:35015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:37119
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:37119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:58.091753 4292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:58.091934 4292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:58.097247 4300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:58.097388 4301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:58.097244 4304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:58.097628 4292 server_base.cc:1034] running on GCE node
I20260811 16:51:58.097932 4292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:58.098374 4292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:58.099567 4292 hybrid_clock.cc:648] HybridClock initialized: now 1786467118099611 us; error 96 us; skew 500 ppm
Aug 11 16:51:58 dist-test-slave-3h5h krb5kdc[4269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467118, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:58.107231 4292 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:51:58.107782 4292 webserver.cc:460] Webserver started at http://127.2.55.190:37225/ using document root <none> and password file <none>
I20260811 16:51:58.108016 4292 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:58.108073 4292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:58.108178 4292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:58.109429 4292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "20a691963afe48d796f6338fd9d71d24"
format_stamp: "Formatted at 2026-08-11 16:51:58 on dist-test-slave-3h5h"
server_key: "df4be4b1cf8577ed8fe72c144df4ede9"
server_key_iv: "b066a0b93f94f5a85872fba732c1e21d"
server_key_version: "encryptionkey@0"
I20260811 16:51:58.109781 4292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "20a691963afe48d796f6338fd9d71d24"
format_stamp: "Formatted at 2026-08-11 16:51:58 on dist-test-slave-3h5h"
server_key: "df4be4b1cf8577ed8fe72c144df4ede9"
server_key_iv: "b066a0b93f94f5a85872fba732c1e21d"
server_key_version: "encryptionkey@0"
I20260811 16:51:58.111317 4292 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:51:58.112224 4314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:58.112644 4292 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:51:58.112771 4292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "20a691963afe48d796f6338fd9d71d24"
format_stamp: "Formatted at 2026-08-11 16:51:58 on dist-test-slave-3h5h"
server_key: "df4be4b1cf8577ed8fe72c144df4ede9"
server_key_iv: "b066a0b93f94f5a85872fba732c1e21d"
server_key_version: "encryptionkey@0"
I20260811 16:51:58.112926 4292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:58.116791 4292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:58.119323 4292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:58.119534 4292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:58.124174 4292 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:37119
I20260811 16:51:58.124207 4389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:37119 every 8 connection(s)
I20260811 16:51:58.124588 4292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:58.125742 4392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:58.126480 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 4292
I20260811 16:51:58.126644 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:58.126852 2270 external_mini_cluster.cc:1428] Setting key f561ce9be5af5dc7a5cd063e67dec7c3
I20260811 16:51:58.129211 4392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24: Bootstrap starting.
I20260811 16:51:58.129551 4395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:58.127458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43301 (local address 127.2.55.190:37119)
0811 16:51:58.127655 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:58.127664 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:58.127693 (+ 29us) server_negotiation.cc:407] Connection header received
0811 16:51:58.128147 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:58.128154 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:58.128181 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:58.128307 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:58.129020 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:58.129025 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:58.129025 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:58.129031 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:58.129094 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:58.129113 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:58.129197 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:58.129318 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 16:51:58.129366 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":98,"threads_started":1}
I20260811 16:51:58.130034 4392 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:58.130389 4392 log.cc:824] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:58.130713 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:51:58.131143 4392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24: No bootstrap required, opened a new log
I20260811 16:51:58.133354 4395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:58.132198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52503 (local address 127.2.55.190:37119)
0811 16:51:58.132238 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:58.132241 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:58.132355 (+ 114us) server_negotiation.cc:407] Connection header received
0811 16:51:58.132432 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:58.132432 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:58.132437 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:58.132485 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:58.133147 (+ 662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:58.133149 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:58.133149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:51:58.133153 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:58.133166 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:51:58.133170 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:58.133217 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:58.133278 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 16:51:58.133288 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:51:58.133685 4392 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20a691963afe48d796f6338fd9d71d24" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37119 } }
I20260811 16:51:58.133864 4392 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:58.133910 4392 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20a691963afe48d796f6338fd9d71d24, State: Initialized, Role: FOLLOWER
I20260811 16:51:58.134042 4392 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20a691963afe48d796f6338fd9d71d24" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37119 } }
I20260811 16:51:58.134132 4392 raft_consensus.cc:388] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:58.134176 4392 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:58.134225 4392 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:58.134776 4392 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20a691963afe48d796f6338fd9d71d24" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37119 } }
I20260811 16:51:58.134891 4392 leader_election.cc:302] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20a691963afe48d796f6338fd9d71d24; no voters:
I20260811 16:51:58.135073 4392 leader_election.cc:288] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:58.135105 4404 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:58.135223 4404 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [term 1 LEADER]: Becoming Leader. State: Replica: 20a691963afe48d796f6338fd9d71d24, State: Running, Role: LEADER
I20260811 16:51:58.135305 4404 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20a691963afe48d796f6338fd9d71d24" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37119 } }
I20260811 16:51:58.135340 4392 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:51:58.135627 4404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20a691963afe48d796f6338fd9d71d24. Latest consensus state: current_term: 1 leader_uuid: "20a691963afe48d796f6338fd9d71d24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20a691963afe48d796f6338fd9d71d24" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37119 } } }
I20260811 16:51:58.135711 4404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:58.135643 4408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20a691963afe48d796f6338fd9d71d24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20a691963afe48d796f6338fd9d71d24" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 37119 } } }
I20260811 16:51:58.135795 4408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:58.136554 4414 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:58.137130 4414 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:58.138721 4414 catalog_manager.cc:1347] Generated new cluster ID: 2a08ee70d0b3435aacc2f112589c961d
I20260811 16:51:58.138793 4414 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:58.160203 4414 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:58.160425 4414 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:58.165660 4414 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20a691963afe48d796f6338fd9d71d24: Generated new TSK 0
I20260811 16:51:58.165868 4414 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:58.172866 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 4292
2026-08-11T16:51:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1656 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:58 dist-test-slave-3h5h krb5kdc[4433](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:58 dist-test-slave-3h5h krb5kdc[4433](info): set up 2 sockets
Aug 11 16:51:58 dist-test-slave-3h5h krb5kdc[4433](info): commencing operation
krb5kdc: starting...
W20260811 16:51:59.512107 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.308s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:51:59 dist-test-slave-3h5h krb5kdc[4433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:51:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:51:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:51:59.639871 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:39067
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:34399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:39067
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:51:59.724828 4456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:51:59.725119 4456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:51:59.725157 4456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:51:59.726322 4456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:51:59.726389 4456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:51:59.726415 4456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:51:59.726449 4456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:51:59.726477 4456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:51:59.727941 4456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:34399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:39067
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:39067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:51:59.728226 4456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:51:59.728459 4456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:51:59.733582 4466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:51:59.733582 4468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:59.733703 4456 server_base.cc:1034] running on GCE node
W20260811 16:51:59.733560 4472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:51:59.734112 4456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:51:59.734431 4456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:51:59.735615 4456 hybrid_clock.cc:648] HybridClock initialized: now 1786467119735588 us; error 55 us; skew 500 ppm
Aug 11 16:51:59 dist-test-slave-3h5h krb5kdc[4433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467119, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:51:59.738536 4456 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:51:59.739001 4456 webserver.cc:460] Webserver started at http://127.2.55.190:33955/ using document root <none> and password file <none>
I20260811 16:51:59.739239 4456 fs_manager.cc:359] Metadata directory not provided
I20260811 16:51:59.739310 4456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:51:59.739465 4456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:51:59.740716 4456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "a7f5e661e3f34283a12fc785fe595b36"
format_stamp: "Formatted at 2026-08-11 16:51:59 on dist-test-slave-3h5h"
server_key: "855c47406bbecdc75f25ec5068178f6a"
server_key_iv: "05105b588e03db0ef6ce4a0f84ce81a1"
server_key_version: "encryptionkey@0"
I20260811 16:51:59.741192 4456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "a7f5e661e3f34283a12fc785fe595b36"
format_stamp: "Formatted at 2026-08-11 16:51:59 on dist-test-slave-3h5h"
server_key: "855c47406bbecdc75f25ec5068178f6a"
server_key_iv: "05105b588e03db0ef6ce4a0f84ce81a1"
server_key_version: "encryptionkey@0"
I20260811 16:51:59.742705 4456 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:51:59.743588 4481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:51:59.743770 4456 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:51:59.743885 4456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "a7f5e661e3f34283a12fc785fe595b36"
format_stamp: "Formatted at 2026-08-11 16:51:59 on dist-test-slave-3h5h"
server_key: "855c47406bbecdc75f25ec5068178f6a"
server_key_iv: "05105b588e03db0ef6ce4a0f84ce81a1"
server_key_version: "encryptionkey@0"
I20260811 16:51:59.743966 4456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:51:59.755177 4456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:51:59.757776 4456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:51:59.757951 4456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:51:59.762537 4456 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:39067
I20260811 16:51:59.762579 4559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:39067 every 8 connection(s)
I20260811 16:51:59.762984 4456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:51:59.763916 4560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:51:59.765375 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 4456
I20260811 16:51:59.765535 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:51:59.765746 2270 external_mini_cluster.cc:1428] Setting key af766d6a4194e7ed750fc67a423da540
I20260811 16:51:59.766748 4560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36: Bootstrap starting.
I20260811 16:51:59.767484 4560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36: Neither blocks nor log segments found. Creating new log.
I20260811 16:51:59.767802 4560 log.cc:824] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36: Log is configured to *not* fsync() on all Append() calls
I20260811 16:51:59.768533 4560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36: No bootstrap required, opened a new log
I20260811 16:51:59.771306 4560 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7f5e661e3f34283a12fc785fe595b36" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39067 } }
I20260811 16:51:59.771492 4560 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:51:59.771579 4560 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7f5e661e3f34283a12fc785fe595b36, State: Initialized, Role: FOLLOWER
I20260811 16:51:59.771765 4560 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7f5e661e3f34283a12fc785fe595b36" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39067 } }
I20260811 16:51:59.771868 4560 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:51:59.771919 4560 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:51:59.771983 4560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:51:59.772599 4560 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7f5e661e3f34283a12fc785fe595b36" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39067 } }
I20260811 16:51:59.772744 4560 leader_election.cc:302] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7f5e661e3f34283a12fc785fe595b36; no voters:
I20260811 16:51:59.773001 4565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:51:59.773025 4560 leader_election.cc:288] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:51:59.773166 4565 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [term 1 LEADER]: Becoming Leader. State: Replica: a7f5e661e3f34283a12fc785fe595b36, State: Running, Role: LEADER
I20260811 16:51:59.773310 4565 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7f5e661e3f34283a12fc785fe595b36" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39067 } }
I20260811 16:51:59.773411 4560 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 16:51:59 dist-test-slave-3h5h krb5kdc[4433](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:51:59.773814 4567 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7f5e661e3f34283a12fc785fe595b36. Latest consensus state: current_term: 1 leader_uuid: "a7f5e661e3f34283a12fc785fe595b36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7f5e661e3f34283a12fc785fe595b36" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39067 } } }
I20260811 16:51:59.773890 4567 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:59.774050 4568 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7f5e661e3f34283a12fc785fe595b36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7f5e661e3f34283a12fc785fe595b36" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 39067 } } }
I20260811 16:51:59.774111 4568 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36 [sys.catalog]: This master's current role is: LEADER
I20260811 16:51:59.774230 4572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:51:59.774758 4572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:51:59.776391 4572 catalog_manager.cc:1347] Generated new cluster ID: 59dcdf52ea8043b4ad474f18fe5580b0
I20260811 16:51:59.776450 4572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:51:59.778828 4563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:59.766334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60329 (local address 127.2.55.190:39067)
0811 16:51:59.766539 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:59.766549 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:59.766590 (+ 41us) server_negotiation.cc:407] Connection header received
0811 16:51:59.767150 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:59.767159 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:59.767225 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:59.767378 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:59.768202 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:59.769284 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:59.770507 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:59.770894 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:59.770975 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:59.774373 (+ 3398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:59.774378 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:59.774379 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:59.774395 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:59.776751 (+ 2356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:59.777213 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:59.777216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:59.777217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:59.777322 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:59.777510 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:59.777511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:59.777511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:59.777808 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:59.777926 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:59.778456 (+ 530us) server_negotiation.cc:299] Negotiation successful
0811 16:51:59.778597 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":95,"threads_started":1}
I20260811 16:51:59.779726 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:51:59.789053 4563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:51:59.781276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55607 (local address 127.2.55.190:39067)
0811 16:51:59.781315 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:51:59.781317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:51:59.781501 (+ 184us) server_negotiation.cc:407] Connection header received
0811 16:51:59.781570 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:51:59.781571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:51:59.781581 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:51:59.781638 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:51:59.782329 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:59.783148 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:59.784186 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:51:59.784525 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:51:59.784591 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:51:59.786073 (+ 1482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:51:59.786075 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:51:59.786075 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:51:59.786160 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:51:59.787833 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:59.788236 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:59.788237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:59.788238 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:59.788296 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:51:59.788493 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:51:59.788493 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:51:59.788494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:51:59.788621 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:51:59.788726 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 16:51:59.788870 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 16:51:59.788948 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:51:59.793247 4572 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:51:59.793951 4572 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:51:59.797730 4572 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a7f5e661e3f34283a12fc785fe595b36: Generated new TSK 0
I20260811 16:51:59.797943 4572 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:51:59.800614 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 4456
2026-08-11T16:51:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1626 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:51:59 dist-test-slave-3h5h krb5kdc[4609](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:51:59 dist-test-slave-3h5h krb5kdc[4609](info): set up 2 sockets
Aug 11 16:51:59 dist-test-slave-3h5h krb5kdc[4609](info): commencing operation
krb5kdc: starting...
W20260811 16:52:01.132570 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.301s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:52:01 dist-test-slave-3h5h krb5kdc[4609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467121, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:52:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:52:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:52:01.272461 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:44855
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:42241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:44855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:52:01.360570 4629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:52:01.360826 4629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:52:01.360896 4629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:52:01.362037 4629 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:52:01.362109 4629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:52:01.362135 4629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:52:01.362159 4629 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:52:01.362195 4629 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:52:01.363723 4629 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:42241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:44855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:44855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:52:01.364006 4629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:52:01.364230 4629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:52:01.369436 4638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:52:01.369426 4636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:52:01.369439 4635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:52:01.369530 4629 server_base.cc:1034] running on GCE node
I20260811 16:52:01.369895 4629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:52:01.370168 4629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:52:01.371354 4629 hybrid_clock.cc:648] HybridClock initialized: now 1786467121371342 us; error 42 us; skew 500 ppm
Aug 11 16:52:01 dist-test-slave-3h5h krb5kdc[4609](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467121, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:52:01.374150 4629 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:52:01.374610 4629 webserver.cc:460] Webserver started at http://127.2.55.190:40887/ using document root <none> and password file <none>
I20260811 16:52:01.374833 4629 fs_manager.cc:359] Metadata directory not provided
I20260811 16:52:01.374907 4629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:52:01.375059 4629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:52:01.376138 4629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "74a0c84ecd174402a42210822e713133"
format_stamp: "Formatted at 2026-08-11 16:52:01 on dist-test-slave-3h5h"
server_key: "7a42a065aecaf45cd201f81746ee7a9b"
server_key_iv: "2d9cacebdd364b7b209db823e155060e"
server_key_version: "encryptionkey@0"
I20260811 16:52:01.376500 4629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "74a0c84ecd174402a42210822e713133"
format_stamp: "Formatted at 2026-08-11 16:52:01 on dist-test-slave-3h5h"
server_key: "7a42a065aecaf45cd201f81746ee7a9b"
server_key_iv: "2d9cacebdd364b7b209db823e155060e"
server_key_version: "encryptionkey@0"
I20260811 16:52:01.378044 4629 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:52:01.378820 4648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:52:01.379077 4629 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:52:01.379186 4629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "74a0c84ecd174402a42210822e713133"
format_stamp: "Formatted at 2026-08-11 16:52:01 on dist-test-slave-3h5h"
server_key: "7a42a065aecaf45cd201f81746ee7a9b"
server_key_iv: "2d9cacebdd364b7b209db823e155060e"
server_key_version: "encryptionkey@0"
I20260811 16:52:01.379266 4629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:52:01.407653 4629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:52:01.410387 4629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:52:01.410555 4629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:52:01.414813 4629 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:44855
I20260811 16:52:01.414867 4737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:44855 every 8 connection(s)
I20260811 16:52:01.415246 4629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:52:01.416181 4738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:52:01.418429 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 4629
I20260811 16:52:01.418553 4738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133: Bootstrap starting.
I20260811 16:52:01.418578 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:52:01.418762 2270 external_mini_cluster.cc:1428] Setting key 50688a4f84e0de76f82bd23d6cc450b1
I20260811 16:52:01.419353 4738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133: Neither blocks nor log segments found. Creating new log.
I20260811 16:52:01.419687 4738 log.cc:824] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133: Log is configured to *not* fsync() on all Append() calls
I20260811 16:52:01.420465 4738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133: No bootstrap required, opened a new log
I20260811 16:52:01.422853 4738 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a0c84ecd174402a42210822e713133" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44855 } }
I20260811 16:52:01.423020 4738 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:52:01.423051 4738 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74a0c84ecd174402a42210822e713133, State: Initialized, Role: FOLLOWER
I20260811 16:52:01.423177 4738 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a0c84ecd174402a42210822e713133" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44855 } }
I20260811 16:52:01.423252 4738 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:52:01.423282 4738 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:52:01.423327 4738 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:52:01.424041 4738 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a0c84ecd174402a42210822e713133" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44855 } }
I20260811 16:52:01.424170 4738 leader_election.cc:302] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74a0c84ecd174402a42210822e713133; no voters:
I20260811 16:52:01.424335 4738 leader_election.cc:288] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:52:01.424357 4746 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:52:01.424470 4746 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [term 1 LEADER]: Becoming Leader. State: Replica: 74a0c84ecd174402a42210822e713133, State: Running, Role: LEADER
I20260811 16:52:01.424604 4738 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:52:01.424609 4746 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a0c84ecd174402a42210822e713133" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44855 } }
I20260811 16:52:01.425093 4748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74a0c84ecd174402a42210822e713133. Latest consensus state: current_term: 1 leader_uuid: "74a0c84ecd174402a42210822e713133" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a0c84ecd174402a42210822e713133" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44855 } } }
I20260811 16:52:01.425230 4748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [sys.catalog]: This master's current role is: LEADER
I20260811 16:52:01.425357 4742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:01.419311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57997 (local address 127.2.55.190:44855)
0811 16:52:01.419544 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:01.419555 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:01.419590 (+ 35us) server_negotiation.cc:407] Connection header received
0811 16:52:01.420165 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:01.420174 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:01.420236 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:01.420388 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:01.420669 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:01.422086 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:01.422867 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:01.423476 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:01.423593 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:01.424352 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:01.424356 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:01.424356 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:52:01.424599 (+ 243us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:01.424638 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:52:01.424654 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:01.425011 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:01.425047 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 16:52:01.425119 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":86,"threads_started":1}
I20260811 16:52:01.425459 4747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74a0c84ecd174402a42210822e713133" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a0c84ecd174402a42210822e713133" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 44855 } } }
I20260811 16:52:01.425725 4747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133 [sys.catalog]: This master's current role is: LEADER
I20260811 16:52:01.426230 4762 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:52:01.426569 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:52:01.426879 4762 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:52:01.428956 4762 catalog_manager.cc:1347] Generated new cluster ID: e13b656c7eb046b696bfb64961530f99
I20260811 16:52:01.429011 4762 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:52:01.431866 4742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:01.428263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52011 (local address 127.2.55.190:44855)
0811 16:52:01.428312 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:01.428314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:01.429039 (+ 725us) server_negotiation.cc:407] Connection header received
0811 16:52:01.429148 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:01.429150 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:01.429159 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:01.429192 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:01.429355 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:01.429835 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:01.430573 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:01.430803 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:01.430882 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:01.431558 (+ 676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:01.431559 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:01.431560 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:52:01.431564 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:01.431597 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:52:01.431602 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:01.431667 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:01.431758 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 16:52:01.431778 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:52:01.437800 4762 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:52:01.438510 4762 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:52:01.448143 4762 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 74a0c84ecd174402a42210822e713133: Generated new TSK 0
I20260811 16:52:01.448354 4762 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:52:01.453248 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 4629
2026-08-11T16:52:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1655 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:52:01 dist-test-slave-3h5h krb5kdc[4787](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:52:01 dist-test-slave-3h5h krb5kdc[4787](info): set up 2 sockets
Aug 11 16:52:01 dist-test-slave-3h5h krb5kdc[4787](info): commencing operation
krb5kdc: starting...
W20260811 16:52:02.789259 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:52:02 dist-test-slave-3h5h krb5kdc[4787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:52:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:52:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:52:02.925117 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:45507
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:39013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:45507
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:52:03.009742 4807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:52:03.009976 4807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:52:03.010001 4807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:52:03.011240 4807 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:52:03.011286 4807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:52:03.011299 4807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:52:03.011312 4807 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:52:03.011368 4807 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:52:03.012964 4807 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:39013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:45507
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:45507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:52:03.013259 4807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:52:03.013500 4807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:52:03.018846 4807 server_base.cc:1034] running on GCE node
W20260811 16:52:03.018813 4815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:52:03.018826 4819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:52:03.018831 4813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:52:03.019418 4807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:52:03.019748 4807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:52:03.020895 4807 hybrid_clock.cc:648] HybridClock initialized: now 1786467123020883 us; error 46 us; skew 500 ppm
Aug 11 16:52:03 dist-test-slave-3h5h krb5kdc[4787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467123, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:52:03.023452 4807 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:52:03.023950 4807 webserver.cc:460] Webserver started at http://127.2.55.190:40599/ using document root <none> and password file <none>
I20260811 16:52:03.024179 4807 fs_manager.cc:359] Metadata directory not provided
I20260811 16:52:03.024246 4807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:52:03.024390 4807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:52:03.025511 4807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "b359291979914477a6364444cb09d7f3"
format_stamp: "Formatted at 2026-08-11 16:52:03 on dist-test-slave-3h5h"
server_key: "ca55d700632947e0c91882fc3a051cef"
server_key_iv: "a6628e34fb0a34026f1bf3d7c9c3658a"
server_key_version: "encryptionkey@0"
I20260811 16:52:03.025879 4807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "b359291979914477a6364444cb09d7f3"
format_stamp: "Formatted at 2026-08-11 16:52:03 on dist-test-slave-3h5h"
server_key: "ca55d700632947e0c91882fc3a051cef"
server_key_iv: "a6628e34fb0a34026f1bf3d7c9c3658a"
server_key_version: "encryptionkey@0"
I20260811 16:52:03.027215 4807 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:52:03.027971 4832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:52:03.028141 4807 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:52:03.028245 4807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "b359291979914477a6364444cb09d7f3"
format_stamp: "Formatted at 2026-08-11 16:52:03 on dist-test-slave-3h5h"
server_key: "ca55d700632947e0c91882fc3a051cef"
server_key_iv: "a6628e34fb0a34026f1bf3d7c9c3658a"
server_key_version: "encryptionkey@0"
I20260811 16:52:03.028317 4807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:52:03.031754 4807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:52:03.034075 4807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:52:03.034230 4807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:52:03.038547 4807 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:45507
I20260811 16:52:03.038599 4911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:45507 every 8 connection(s)
I20260811 16:52:03.038944 4807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:52:03.040115 4912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:52:03.040723 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 4807
I20260811 16:52:03.040921 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:52:03.041123 2270 external_mini_cluster.cc:1428] Setting key e07ffd2a49036dcae332a8d6102f36c5
I20260811 16:52:03.043887 4912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3: Bootstrap starting.
I20260811 16:52:03.043954 4916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:03.041721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33345 (local address 127.2.55.190:45507)
0811 16:52:03.041977 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:03.041987 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:03.042034 (+ 47us) server_negotiation.cc:407] Connection header received
0811 16:52:03.042605 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:03.042614 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:03.042661 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:03.042818 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:03.043475 (+ 657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:03.043480 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:03.043480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:52:03.043485 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:03.043555 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:52:03.043571 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:03.043646 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:03.043712 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 16:52:03.043754 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":115,"threads_started":1}
I20260811 16:52:03.044693 4912 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3: Neither blocks nor log segments found. Creating new log.
I20260811 16:52:03.044960 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:52:03.045094 4912 log.cc:824] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3: Log is configured to *not* fsync() on all Append() calls
I20260811 16:52:03.045854 4912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3: No bootstrap required, opened a new log
I20260811 16:52:03.047734 4916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:03.046595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42555 (local address 127.2.55.190:45507)
0811 16:52:03.046655 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:03.046657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:03.046761 (+ 104us) server_negotiation.cc:407] Connection header received
0811 16:52:03.046838 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:03.046839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:03.046845 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:03.046902 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:03.047513 (+ 611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:03.047514 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:03.047515 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:52:03.047519 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:03.047533 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:52:03.047537 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:03.047583 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:03.047636 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 16:52:03.047651 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:52:03.048010 4912 raft_consensus.cc:348] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b359291979914477a6364444cb09d7f3" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45507 } }
I20260811 16:52:03.048193 4912 raft_consensus.cc:374] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:52:03.048242 4912 raft_consensus.cc:729] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b359291979914477a6364444cb09d7f3, State: Initialized, Role: FOLLOWER
I20260811 16:52:03.048372 4912 consensus_queue.cc:260] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b359291979914477a6364444cb09d7f3" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45507 } }
I20260811 16:52:03.048465 4912 raft_consensus.cc:388] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:52:03.048509 4912 raft_consensus.cc:482] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:52:03.048565 4912 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:52:03.049240 4912 raft_consensus.cc:504] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b359291979914477a6364444cb09d7f3" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45507 } }
I20260811 16:52:03.049364 4912 leader_election.cc:302] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b359291979914477a6364444cb09d7f3; no voters:
I20260811 16:52:03.049544 4912 leader_election.cc:288] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:52:03.049682 4925 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:52:03.049814 4912 sys_catalog.cc:564] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:52:03.049897 4925 raft_consensus.cc:686] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [term 1 LEADER]: Becoming Leader. State: Replica: b359291979914477a6364444cb09d7f3, State: Running, Role: LEADER
I20260811 16:52:03.050096 4925 consensus_queue.cc:237] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b359291979914477a6364444cb09d7f3" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45507 } }
I20260811 16:52:03.050633 4926 sys_catalog.cc:455] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b359291979914477a6364444cb09d7f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b359291979914477a6364444cb09d7f3" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45507 } } }
I20260811 16:52:03.050635 4928 sys_catalog.cc:455] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b359291979914477a6364444cb09d7f3. Latest consensus state: current_term: 1 leader_uuid: "b359291979914477a6364444cb09d7f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b359291979914477a6364444cb09d7f3" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 45507 } } }
I20260811 16:52:03.050768 4926 sys_catalog.cc:458] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [sys.catalog]: This master's current role is: LEADER
I20260811 16:52:03.050776 4928 sys_catalog.cc:458] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3 [sys.catalog]: This master's current role is: LEADER
I20260811 16:52:03.051026 4942 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:52:03.051676 4942 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:52:03.053452 4942 catalog_manager.cc:1347] Generated new cluster ID: 00efb79248bb4734a632945550a6c8c8
I20260811 16:52:03.053550 4942 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:52:03.059051 4942 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:52:03.059245 4942 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:52:03.069250 4942 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b359291979914477a6364444cb09d7f3: Generated new TSK 0
I20260811 16:52:03.069504 4942 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:52:03.072234 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 4807
2026-08-11T16:52:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1612 ms)
[----------] 18 tests from AuthTokenIssuingTest (29078 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:52:03 dist-test-slave-3h5h krb5kdc[4959](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:52:03 dist-test-slave-3h5h krb5kdc[4959](info): set up 2 sockets
Aug 11 16:52:03 dist-test-slave-3h5h krb5kdc[4959](info): commencing operation
krb5kdc: starting...
W20260811 16:52:04.420351 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.322s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:52:04 dist-test-slave-3h5h krb5kdc[4959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:52:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:52:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:52:04.556772 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:42999
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:45159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:42999,127.2.55.189:37549,127.2.55.188:35435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:52:04.647957 4982 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:52:04.648275 4982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:52:04.648293 4982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:52:04.648314 4982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:52:04.649430 4982 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:52:04.649467 4982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:52:04.649482 4982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:52:04.649494 4982 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:52:04.649505 4982 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:52:04.650936 4982 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:45159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:42999,127.2.55.189:37549,127.2.55.188:35435
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:42999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:52:04.651139 4982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:52:04.651306 4982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:52:04.656524 4993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:52:04.656538 4992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:52:04.656535 4996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:52:04.656697 4982 server_base.cc:1034] running on GCE node
I20260811 16:52:04.657042 4982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:52:04.657315 4982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:52:04.658461 4982 hybrid_clock.cc:648] HybridClock initialized: now 1786467124658448 us; error 30 us; skew 500 ppm
Aug 11 16:52:04 dist-test-slave-3h5h krb5kdc[4959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467124, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:52:04.661064 4982 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:52:04.661571 4982 webserver.cc:460] Webserver started at http://127.2.55.190:46439/ using document root <none> and password file <none>
I20260811 16:52:04.661813 4982 fs_manager.cc:359] Metadata directory not provided
I20260811 16:52:04.661883 4982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:52:04.662043 4982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:52:04.663198 4982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "30d02ebe196f44c3ace7b6a924e7eab5"
format_stamp: "Formatted at 2026-08-11 16:52:04 on dist-test-slave-3h5h"
server_key: "45b070783e84e2202a640da0710127ac"
server_key_iv: "107345f3e06186d375121d707802109f"
server_key_version: "encryptionkey@0"
I20260811 16:52:04.663565 4982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "30d02ebe196f44c3ace7b6a924e7eab5"
format_stamp: "Formatted at 2026-08-11 16:52:04 on dist-test-slave-3h5h"
server_key: "45b070783e84e2202a640da0710127ac"
server_key_iv: "107345f3e06186d375121d707802109f"
server_key_version: "encryptionkey@0"
I20260811 16:52:04.665113 4982 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 16:52:04.665961 5008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:52:04.666225 4982 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:52:04.666340 4982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "30d02ebe196f44c3ace7b6a924e7eab5"
format_stamp: "Formatted at 2026-08-11 16:52:04 on dist-test-slave-3h5h"
server_key: "45b070783e84e2202a640da0710127ac"
server_key_iv: "107345f3e06186d375121d707802109f"
server_key_version: "encryptionkey@0"
I20260811 16:52:04.666417 4982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:52:04.673740 4982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:52:04.675546 4982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:52:04.675716 4982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:52:04.680352 4982 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:42999
I20260811 16:52:04.680404 5089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:42999 every 8 connection(s)
I20260811 16:52:04.680775 4982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:52:04.681823 5092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:52:04.683208 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 4982
I20260811 16:52:04.683341 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:52:04.683514 2270 external_mini_cluster.cc:1428] Setting key 6f9a5a5214aec80a004e278a5b2b0d86
I20260811 16:52:04.683463 5092 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:52:04 dist-test-slave-3h5h krb5kdc[4959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467124, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.55.189@KRBTEST.COM; defaulting to no policy
I20260811 16:52:04.694060 5098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.684287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41832 (local address 127.2.55.190:42999)
0811 16:52:04.684459 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:04.684469 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:04.684603 (+ 134us) server_negotiation.cc:407] Connection header received
0811 16:52:04.685223 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:04.685225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:04.685242 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:04.685339 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:04.685901 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:04.686723 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:04.687642 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:04.688025 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:04.688159 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:04.690304 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:04.690312 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:04.690313 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:04.690319 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:04.692179 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:04.692584 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:04.692587 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:04.692587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:04.692670 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:04.692938 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:04.692939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:04.692939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:04.693327 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:04.693428 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:04.693646 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 16:52:04.693807 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":90,"threads_started":1}
I20260811 16:52:04.694065 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.684242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:42999 (local address 127.0.0.1:41832)
0811 16:52:04.684426 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.684468 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:04.685049 (+ 581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:04.685345 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:04.685347 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:04.685632 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:04.685785 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:04.685789 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:04.686865 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:04.686866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:04.687536 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:04.687539 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:04.688150 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:04.688151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:04.688217 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:04.688766 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:04.688774 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:04.690205 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:04.692277 (+ 2072us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:04.692283 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:04.692285 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:04.692474 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:04.692744 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:04.692745 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:04.692745 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:04.692872 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:04.693418 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:04.693424 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:04.693499 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 16:52:04.693597 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 16:52:04.693875 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":129,"thread_start_us":86,"threads_started":1}
I20260811 16:52:04.694978 5092 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.189@KRBTEST.COM" created.
I20260811 16:52:04.695380 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.695253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37549 (local address 127.0.0.1:51524)
0811 16:52:04.695309 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.695357 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 16:52:04.695513 5014 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37549: connect: Connection refused (error 111)
I20260811 16:52:04.695971 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.695886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37549 (local address 127.0.0.1:51532)
0811 16:52:04.695924 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.695951 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260811 16:52:04.696108 5092 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.189:37549: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37549: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.189.keytab.
Entry for principal kudu/127.2.55.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.189.keytab.
I20260811 16:52:04.713212 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.189:37549
--webserver_interface=127.2.55.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.189.keytab
--principal=kudu/127.2.55.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:45159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:42999,127.2.55.189:37549,127.2.55.188:35435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:52:04.745373 5092 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } attempt: 1
I20260811 16:52:04.745919 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.745768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37549 (local address 127.0.0.1:51546)
0811 16:52:04.745844 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.745886 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 16:52:04.746318 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.746211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37549 (local address 127.0.0.1:51560)
0811 16:52:04.746267 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.746298 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 16:52:04.746413 5092 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.189:37549: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37549: connect: Connection refused (error 111)
W20260811 16:52:04.803287 5104 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:52:04.803551 5104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:52:04.803581 5104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:52:04.803622 5104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:52:04.804767 5104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:52:04.804844 5104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:52:04.804893 5104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:52:04.804925 5104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:52:04.804949 5104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:52:04.806609 5104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:45159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:42999,127.2.55.189:37549,127.2.55.188:35435
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.189.keytab
--principal=kudu/127.2.55.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.189:37549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.55.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:52:04.806916 5104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:52:04.807296 5104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:52:04.812579 5111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:52:04.812610 5110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:52:04.812656 5113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:52:04.812786 5104 server_base.cc:1034] running on GCE node
I20260811 16:52:04.813261 5104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:52:04.813578 5104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:52:04.814584 5092 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } attempt: 2
I20260811 16:52:04.814795 5104 hybrid_clock.cc:648] HybridClock initialized: now 1786467124814790 us; error 66 us; skew 500 ppm
I20260811 16:52:04.815109 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.814907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37549 (local address 127.0.0.1:51574)
0811 16:52:04.814988 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.815026 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 16:52:04.815569 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.815463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37549 (local address 127.0.0.1:51590)
0811 16:52:04.815516 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.815551 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 16:52:04.815711 5092 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.189:37549: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37549: connect: Connection refused (error 111)
Aug 11 16:52:04 dist-test-slave-3h5h krb5kdc[4959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467124, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:52:04.817898 5104 init.cc:377] Logged in from keytab as kudu/127.2.55.189@KRBTEST.COM (short username kudu)
I20260811 16:52:04.818408 5104 webserver.cc:460] Webserver started at http://127.2.55.189:44151/ using document root <none> and password file <none>
I20260811 16:52:04.818678 5104 fs_manager.cc:359] Metadata directory not provided
I20260811 16:52:04.818729 5104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:52:04.818919 5104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:52:04.820150 5104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/data/instance:
uuid: "51fcf3d2757a4a6ba6372211f0d45f6d"
format_stamp: "Formatted at 2026-08-11 16:52:04 on dist-test-slave-3h5h"
server_key: "ee888550254cd57537daac1942708b7d"
server_key_iv: "855e86276ff78f2d1d7567fd00032c43"
server_key_version: "encryptionkey@0"
I20260811 16:52:04.820561 5104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/wal/instance:
uuid: "51fcf3d2757a4a6ba6372211f0d45f6d"
format_stamp: "Formatted at 2026-08-11 16:52:04 on dist-test-slave-3h5h"
server_key: "ee888550254cd57537daac1942708b7d"
server_key_iv: "855e86276ff78f2d1d7567fd00032c43"
server_key_version: "encryptionkey@0"
I20260811 16:52:04.822141 5104 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:52:04.823009 5128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:52:04.823284 5104 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:52:04.823395 5104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/wal
uuid: "51fcf3d2757a4a6ba6372211f0d45f6d"
format_stamp: "Formatted at 2026-08-11 16:52:04 on dist-test-slave-3h5h"
server_key: "ee888550254cd57537daac1942708b7d"
server_key_iv: "855e86276ff78f2d1d7567fd00032c43"
server_key_version: "encryptionkey@0"
I20260811 16:52:04.823474 5104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:52:04.833243 5104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:52:04.835489 5104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:52:04.835763 5104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:52:04.840087 5104 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.189:37549
I20260811 16:52:04.840168 5224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.189:37549 every 8 connection(s)
I20260811 16:52:04.840561 5104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/data/info.pb
I20260811 16:52:04.841720 5227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:52:04.843343 5227 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:52:04 dist-test-slave-3h5h krb5kdc[4959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467124, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.189@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:52:04.849879 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 5104
I20260811 16:52:04.850018 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-1/wal/instance
I20260811 16:52:04.850304 2270 external_mini_cluster.cc:1428] Setting key c4a2af7a0f66ff5f1df08633685aa157
I20260811 16:52:04.853358 5098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.844231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41848 (local address 127.2.55.190:42999)
0811 16:52:04.844310 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:04.844313 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:04.844515 (+ 202us) server_negotiation.cc:407] Connection header received
0811 16:52:04.845067 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:04.845069 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:04.845083 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:04.845145 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:04.845771 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:04.846333 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:04.847427 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:04.847636 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:04.847723 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:04.849950 (+ 2227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:04.849951 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:04.849952 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:04.849961 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:04.851532 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:04.852192 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:04.852194 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:04.852194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:04.852273 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:04.852568 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:04.852570 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:04.852570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:04.852730 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:04.852804 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:04.853139 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 16:52:04.853252 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 16:52:04.853426 5229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.844187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:42999 (local address 127.0.0.1:41848)
0811 16:52:04.844373 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.844414 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:04.844930 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:04.845231 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:04.845235 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:04.845490 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:04.845688 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:04.845692 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:04.846457 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:04.846458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:04.847305 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:04.847308 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:04.847746 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:04.847748 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:04.847879 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:04.848375 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:04.848384 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:04.849846 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:04.851624 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:04.851632 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:04.851634 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:04.851968 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:04.852352 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:04.852353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:04.852354 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:04.852459 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:04.852810 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:04.852816 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:04.852997 (+ 181us) client_negotiation.cc:769] Sending connection context
0811 16:52:04.853093 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 16:52:04.853233 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":94,"threads_started":1}
I20260811 16:52:04.854069 5227 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:52:04 dist-test-slave-3h5h krb5kdc[4959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467124, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.189@KRBTEST.COM for kudu/127.2.55.189@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.55.188@KRBTEST.COM; defaulting to no policy
I20260811 16:52:04.862030 5229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.854362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37549 (local address 127.0.0.1:51602)
0811 16:52:04.854613 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.854624 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:04.854676 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:04.854808 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:04.854809 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:04.854972 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:04.855034 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:04.855036 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:04.855867 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:04.855868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:04.856748 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:04.856751 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:04.857313 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:04.857314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:04.857403 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:04.857787 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:04.857792 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:04.859059 (+ 1267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:04.860932 (+ 1873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:04.860933 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:04.860934 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:04.861098 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:04.861330 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:04.861330 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:04.861331 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:04.861389 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:04.861676 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:04.861677 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:04.861715 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 16:52:04.861780 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 16:52:04.861885 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234}
I20260811 16:52:04.862118 5232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.854437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51602 (local address 127.2.55.189:37549)
0811 16:52:04.854633 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:04.854637 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:04.854672 (+ 35us) server_negotiation.cc:407] Connection header received
0811 16:52:04.854730 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:04.854731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:04.854742 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:04.854805 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:04.855133 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:04.855779 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:04.856889 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:04.857228 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:04.857286 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:04.859181 (+ 1895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:04.859189 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:04.859190 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:04.859197 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:04.860785 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:04.861197 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:04.861200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:04.861200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:04.861258 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:04.861455 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:04.861456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:04.861456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:04.861600 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:04.861698 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:04.861833 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 16:52:04.861956 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":168,"thread_start_us":119,"threads_started":1}
I20260811 16:52:04.862864 5227 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:52:04.863281 5229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.863101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:35435 (local address 127.0.0.1:57108)
0811 16:52:04.863172 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.863246 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:35435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.188@KRBTEST.COM" created.
W20260811 16:52:04.863452 5143 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.55.188:35435: connect: Connection refused (error 111)
I20260811 16:52:04.863935 5229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.863833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:35435 (local address 127.0.0.1:57114)
0811 16:52:04.863887 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.863912 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:35435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 16:52:04.864037 5227 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.188:35435: Network error: Client connection negotiation failed: client connection to 127.2.55.188:35435: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.188.keytab.
Entry for principal kudu/127.2.55.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.188.keytab.
I20260811 16:52:04.881488 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.188:35435
--webserver_interface=127.2.55.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.188.keytab
--principal=kudu/127.2.55.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:45159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:42999,127.2.55.189:37549,127.2.55.188:35435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:52:04.906881 5092 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } attempt: 3
Aug 11 16:52:04 dist-test-slave-3h5h krb5kdc[4959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467124, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for kudu/127.2.55.189@KRBTEST.COM
I20260811 16:52:04.913305 5227 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } attempt: 1
I20260811 16:52:04.913767 5229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.913591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:35435 (local address 127.0.0.1:57116)
0811 16:52:04.913663 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.913724 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:35435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 16:52:04.914430 5229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.914319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:35435 (local address 127.0.0.1:57132)
0811 16:52:04.914370 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.914404 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:35435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 16:52:04.914594 5227 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.188:35435: Network error: Client connection negotiation failed: client connection to 127.2.55.188:35435: connect: Connection refused (error 111)
I20260811 16:52:04.914940 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.907274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37549 (local address 127.0.0.1:51604)
0811 16:52:04.907333 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.907345 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:04.907421 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:04.907579 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:04.907580 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:04.907761 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:04.907841 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:04.907844 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:04.908642 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:04.908643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:04.909251 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:04.909254 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:04.909680 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:04.909681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:04.909770 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:04.910293 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:04.910298 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:04.911749 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:04.913781 (+ 2032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:04.913782 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:04.913782 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:04.914014 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:04.914248 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:04.914249 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:04.914249 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:04.914318 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:04.914669 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:04.914670 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:04.914722 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 16:52:04.914789 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 16:52:04.914877 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 16:52:04.915021 5232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.907355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51604 (local address 127.2.55.189:37549)
0811 16:52:04.907428 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:04.907431 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:04.907444 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:52:04.907479 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:04.907480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:04.907492 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:04.907559 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:04.907931 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:04.908515 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:04.909363 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:04.909598 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:04.909682 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:04.911846 (+ 2164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:04.911847 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:04.911848 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:04.911857 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:04.913650 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:04.914100 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:04.914101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:04.914102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:04.914168 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:04.914392 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:04.914393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:04.914394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:04.914569 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:04.914637 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:04.914847 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 16:52:04.914941 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:52:04.915962 5092 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:52:04.916366 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.916257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:35435 (local address 127.0.0.1:57136)
0811 16:52:04.916309 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.916337 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:35435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 16:52:04.916764 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.916672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:35435 (local address 127.0.0.1:57142)
0811 16:52:04.916721 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.916746 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:35435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 16:52:04.916914 5092 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.188:35435: Network error: Client connection negotiation failed: client connection to 127.2.55.188:35435: connect: Connection refused (error 111)
I20260811 16:52:04.948107 5092 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } attempt: 1
I20260811 16:52:04.948688 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.948510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:35435 (local address 127.0.0.1:57148)
0811 16:52:04.948590 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.948646 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:35435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 16:52:04.949108 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.948981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:35435 (local address 127.0.0.1:57158)
0811 16:52:04.949041 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.949077 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:35435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 16:52:04.949273 5092 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.188:35435: Network error: Client connection negotiation failed: client connection to 127.2.55.188:35435: connect: Connection refused (error 111)
W20260811 16:52:04.975189 5235 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:52:04.975422 5235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:52:04.975442 5235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:52:04.975469 5235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:52:04.976583 5235 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:52:04.976624 5235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:52:04.976640 5235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:52:04.976655 5235 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:52:04.976670 5235 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:52:04.978276 5235 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:45159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:42999,127.2.55.189:37549,127.2.55.188:35435
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.188.keytab
--principal=kudu/127.2.55.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.188:35435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.55.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:52:04.978515 5235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:52:04.978715 5235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:52:04.982739 5227 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } attempt: 2
I20260811 16:52:04.983249 5229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.983031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:35435 (local address 127.0.0.1:57172)
0811 16:52:04.983091 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.983152 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:35435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 16:52:04.983839 5229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:04.983684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:35435 (local address 127.0.0.1:57186)
0811 16:52:04.983754 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:04.983813 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:35435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 16:52:04.983942 5227 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.188:35435: Network error: Client connection negotiation failed: client connection to 127.2.55.188:35435: connect: Connection refused (error 111)
W20260811 16:52:04.983985 5247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:52:04.984169 5246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:52:04.984170 5249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:52:04.984493 5235 server_base.cc:1034] running on GCE node
I20260811 16:52:04.984728 5235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:52:04.985047 5235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:52:04.986198 5235 hybrid_clock.cc:648] HybridClock initialized: now 1786467124986185 us; error 27 us; skew 500 ppm
Aug 11 16:52:04 dist-test-slave-3h5h krb5kdc[4959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467124, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:52:04.989050 5235 init.cc:377] Logged in from keytab as kudu/127.2.55.188@KRBTEST.COM (short username kudu)
I20260811 16:52:04.989610 5235 webserver.cc:460] Webserver started at http://127.2.55.188:35195/ using document root <none> and password file <none>
I20260811 16:52:04.989854 5235 fs_manager.cc:359] Metadata directory not provided
I20260811 16:52:04.989899 5235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:52:04.990072 5235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:52:04.991183 5235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/data/instance:
uuid: "151cd398ad4d425984e1fc5e6534eda4"
format_stamp: "Formatted at 2026-08-11 16:52:04 on dist-test-slave-3h5h"
server_key: "e3deab2c5a8638968cfae6077c951c24"
server_key_iv: "e4464533618b86ac7849663a0df9a3c0"
server_key_version: "encryptionkey@0"
I20260811 16:52:04.991560 5235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/wal/instance:
uuid: "151cd398ad4d425984e1fc5e6534eda4"
format_stamp: "Formatted at 2026-08-11 16:52:04 on dist-test-slave-3h5h"
server_key: "e3deab2c5a8638968cfae6077c951c24"
server_key_iv: "e4464533618b86ac7849663a0df9a3c0"
server_key_version: "encryptionkey@0"
I20260811 16:52:04.993127 5235 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:52:04.994063 5263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:52:04.994313 5235 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:52:04.994436 5235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/wal
uuid: "151cd398ad4d425984e1fc5e6534eda4"
format_stamp: "Formatted at 2026-08-11 16:52:04 on dist-test-slave-3h5h"
server_key: "e3deab2c5a8638968cfae6077c951c24"
server_key_iv: "e4464533618b86ac7849663a0df9a3c0"
server_key_version: "encryptionkey@0"
I20260811 16:52:04.994503 5235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:52:05.006053 5235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:52:05.008926 5235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:52:05.009130 5235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:52:05.014055 5235 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.188:35435
I20260811 16:52:05.014142 5337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.188:35435 every 8 connection(s)
I20260811 16:52:05.014544 5235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/data/info.pb
I20260811 16:52:05.015762 5341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:52:05.017546 5341 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:52:05.020020 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 5235
I20260811 16:52:05.020200 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466835675343-2270-0/minicluster-data/master-2/wal/instance
I20260811 16:52:05.020395 2270 external_mini_cluster.cc:1428] Setting key c9f4810670ac12bca6d0cc2d56bf360e
I20260811 16:52:05.024452 5092 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } attempt: 2
Aug 11 16:52:05 dist-test-slave-3h5h krb5kdc[4959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467124, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.188@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
Aug 11 16:52:05 dist-test-slave-3h5h krb5kdc[4959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.188@KRBTEST.COM
I20260811 16:52:05.029188 5098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:05.018431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41850 (local address 127.2.55.190:42999)
0811 16:52:05.018510 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.018513 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.018932 (+ 419us) server_negotiation.cc:407] Connection header received
0811 16:52:05.019380 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.019382 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.019393 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.019459 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.020149 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.020900 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.022429 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.022643 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.022737 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:05.025601 (+ 2864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:05.025603 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:05.025603 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:05.025611 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:05.027434 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.027937 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.027938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.027938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.028014 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.028353 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.028354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.028355 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.028502 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:05.028576 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:05.028991 (+ 415us) server_negotiation.cc:299] Negotiation successful
0811 16:52:05.029090 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 16:52:05.029799 5343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:05.018382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:42999 (local address 127.0.0.1:41850)
0811 16:52:05.018658 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:05.018704 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:05.019262 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:05.019518 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:05.019521 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:05.019807 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:05.020019 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:05.020023 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.021019 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.021021 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:05.022334 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:05.022337 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.022767 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.022768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:05.022915 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:05.023468 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:05.023479 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:05.025482 (+ 2003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:05.027528 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:05.027535 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:05.027538 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:05.027883 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:05.028091 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:05.028092 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:05.028092 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:05.028259 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:05.028576 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:05.028609 (+ 33us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:05.028794 (+ 185us) client_negotiation.cc:769] Sending connection context
0811 16:52:05.029327 (+ 533us) client_negotiation.cc:240] Negotiation successful
0811 16:52:05.029535 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":195,"threads_started":1}
Aug 11 16:52:05 dist-test-slave-3h5h krb5kdc[4959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467124, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for kudu/127.2.55.188@KRBTEST.COM
I20260811 16:52:05.030543 5341 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:52:05.031361 5345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:05.020891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57190 (local address 127.2.55.188:35435)
0811 16:52:05.021181 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.021185 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.021205 (+ 20us) server_negotiation.cc:407] Connection header received
0811 16:52:05.021227 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.021229 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.021253 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.021334 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.022142 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.022812 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.023789 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.024083 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.024190 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:05.027373 (+ 3183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:05.027382 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:05.027383 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:05.027390 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:05.029770 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.030380 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.030383 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.030383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.030435 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.030697 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.030698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.030699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.030882 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:05.031024 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:05.031125 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 16:52:05.031249 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":89,"threads_started":1}
I20260811 16:52:05.034430 5097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:05.024722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:35435 (local address 127.0.0.1:57194)
0811 16:52:05.024796 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:05.024809 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:05.024884 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:05.025230 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:05.025231 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:05.025379 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:05.025413 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:05.025414 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.026187 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.026188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:05.027691 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:05.027694 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.028162 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.028163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:05.028222 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:05.028779 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:05.028784 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:05.030384 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:05.033303 (+ 2919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:05.033304 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:05.033304 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:05.033531 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:05.033805 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:05.033806 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:05.033807 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:05.033879 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:05.034146 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:05.034147 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:05.034189 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 16:52:05.034235 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 16:52:05.034328 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 16:52:05.034829 5346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:05.024825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57194 (local address 127.2.55.188:35435)
0811 16:52:05.025103 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.025105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.025113 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:52:05.025133 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.025133 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.025143 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.025210 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.025515 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.026111 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.027757 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.028081 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.028143 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:05.030478 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:05.030486 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:05.030486 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:05.030493 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:05.033236 (+ 2743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.033619 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.033621 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.033621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.033718 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.033937 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.033939 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.033939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.034063 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:05.034547 (+ 484us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:05.034599 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 16:52:05.034700 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":82,"threads_started":1}
Aug 11 16:52:05 dist-test-slave-3h5h krb5kdc[4959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467124, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.188@KRBTEST.COM for kudu/127.2.55.189@KRBTEST.COM
I20260811 16:52:05.036621 5092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5: Bootstrap starting.
I20260811 16:52:05.037529 5092 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5: Neither blocks nor log segments found. Creating new log.
I20260811 16:52:05.037861 5092 log.cc:824] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5: Log is configured to *not* fsync() on all Append() calls
Aug 11 16:52:05 dist-test-slave-3h5h krb5kdc[4959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:52:05.038879 5092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5: No bootstrap required, opened a new log
I20260811 16:52:05.040079 5232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:05.030929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51618 (local address 127.2.55.189:37549)
0811 16:52:05.030993 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.030995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.031006 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:52:05.031075 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.031076 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.031087 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.031143 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.031858 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.032330 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.033436 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.033781 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.033854 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:05.036126 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:05.036128 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:05.036128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:05.036137 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:05.038624 (+ 2487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.039060 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.039061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.039061 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.039137 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.039365 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.039367 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.039367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.039523 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:05.039576 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:05.039854 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 16:52:05.039943 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:52:05.040299 5343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:05.030827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37549 (local address 127.0.0.1:51618)
0811 16:52:05.030968 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:05.030979 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:05.031019 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:05.031147 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:05.031147 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:05.031352 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:05.031751 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:05.031754 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.032427 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.032477 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:05.033342 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:05.033345 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.033847 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.033848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:05.033950 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:05.034410 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:05.034415 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:05.036025 (+ 1610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:05.038726 (+ 2701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:05.038727 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:05.038728 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:05.038940 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:05.039213 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:05.039214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:05.039214 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:05.039286 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:05.039674 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:05.039675 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:05.039713 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 16:52:05.039794 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 16:52:05.040173 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125}
I20260811 16:52:05.040881 5341 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:52:05.041287 5092 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } }
I20260811 16:52:05.041530 5092 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d02ebe196f44c3ace7b6a924e7eab5, State: Initialized, Role: FOLLOWER
I20260811 16:52:05.041648 5092 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } }
I20260811 16:52:05.042141 5092 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:52:05.042286 5098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:05.032910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41854 (local address 127.2.55.190:42999)
0811 16:52:05.032951 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.032952 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.033094 (+ 142us) server_negotiation.cc:407] Connection header received
0811 16:52:05.033146 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.033147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.033159 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.033217 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.033987 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.034659 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.035779 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.036095 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.036140 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:05.039157 (+ 3017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:05.039159 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:05.039159 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:05.039166 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:05.040778 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.041413 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.041415 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.041415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.041488 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.041712 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.041713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.041714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.041840 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:05.042031 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:05.042084 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 16:52:05.042172 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:52:05.042462 5348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } } }
I20260811 16:52:05.042598 5348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [sys.catalog]: This master's current role is: FOLLOWER
Aug 11 16:52:05 dist-test-slave-3h5h krb5kdc[4959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467124, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.188@KRBTEST.COM for kudu/127.2.55.188@KRBTEST.COM
W20260811 16:52:05.044622 5366 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:52:05.045653 5366 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 11 16:52:05 dist-test-slave-3h5h krb5kdc[4959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.189@KRBTEST.COM
I20260811 16:52:05.049108 5343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:05.041196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:35435 (local address 127.0.0.1:57198)
0811 16:52:05.041244 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:05.041255 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:05.041294 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:05.041461 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:05.041462 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:05.041620 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:05.041656 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:05.041658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.042549 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.042550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:05.043241 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:05.043244 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.043689 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.043690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:05.043741 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:05.044173 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:05.044178 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:05.046065 (+ 1887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:05.048001 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:05.048002 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:05.048002 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:05.048203 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:05.048385 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:05.048385 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:05.048385 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:05.048434 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:05.048760 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:05.048761 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:05.048797 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 16:52:05.048923 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 16:52:05.049013 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 16:52:05.049445 5346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:05.041263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57198 (local address 127.2.55.188:35435)
0811 16:52:05.041301 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.041303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.041315 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:52:05.041343 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.041344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.041353 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.041408 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.041738 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.042451 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.043332 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.043592 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.043688 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:05.046164 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:05.046166 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:05.046166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:05.046174 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:05.047907 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.048276 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.048277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.048277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.048324 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.048493 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.048494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.048494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.048674 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:05.048739 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:05.049286 (+ 547us) server_negotiation.cc:299] Negotiation successful
0811 16:52:05.049365 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:52:05.051355 5341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4: Bootstrap starting.
I20260811 16:52:05.052193 5341 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4: Neither blocks nor log segments found. Creating new log.
I20260811 16:52:05.052567 5341 log.cc:824] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4: Log is configured to *not* fsync() on all Append() calls
I20260811 16:52:05.053223 5232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:05.042988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51630 (local address 127.2.55.189:37549)
0811 16:52:05.043028 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.043030 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.043041 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:52:05.043065 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.043066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.043075 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.043151 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.043791 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.044526 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.045411 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.045713 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.045781 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:05.049892 (+ 4111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:05.049893 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:05.049894 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:05.049902 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:05.051716 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.052188 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.052189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.052190 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.052275 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.052561 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.052563 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.052563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.052727 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:05.052916 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:05.053033 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 16:52:05.053132 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:52:05.047225 4982 master_runner.cc:186] Error getting master registration for 127.2.55.189:37549: OK, instance_id { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" instance_seqno: 1786467124838836 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:52:05.053894 4982 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:52:05.054682 5341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4: No bootstrap required, opened a new log
I20260811 16:52:05.054942 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:52:05.056156 5050 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "30d02ebe196f44c3ace7b6a924e7eab5"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41854
I20260811 16:52:05.056303 5050 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:52:05.056353 5050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:52:05.056634 5341 raft_consensus.cc:348] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } }
I20260811 16:52:05.056787 5341 raft_consensus.cc:729] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 151cd398ad4d425984e1fc5e6534eda4, State: Initialized, Role: FOLLOWER
I20260811 16:52:05.056923 5341 consensus_queue.cc:260] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } }
I20260811 16:52:05.057303 5341 sys_catalog.cc:564] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:52:05.057265 5370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } } }
I20260811 16:52:05.057358 5370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:52:05.057437 5050 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } }
I20260811 16:52:05.057710 5050 leader_election.cc:288] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [CANDIDATE]: Term 1 election: Requested vote from peers 51fcf3d2757a4a6ba6372211f0d45f6d (127.2.55.189:37549), 151cd398ad4d425984e1fc5e6534eda4 (127.2.55.188:35435)
I20260811 16:52:05.058037 5302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "151cd398ad4d425984e1fc5e6534eda4"
I20260811 16:52:05.058173 5302 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:52:05.059108 5302 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d02ebe196f44c3ace7b6a924e7eab5 in term 1.
I20260811 16:52:05.059345 5014 leader_election.cc:302] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 151cd398ad4d425984e1fc5e6534eda4, 30d02ebe196f44c3ace7b6a924e7eab5; no voters:
I20260811 16:52:05.059485 5348 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:52:05.059638 5348 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [term 1 LEADER]: Becoming Leader. State: Replica: 30d02ebe196f44c3ace7b6a924e7eab5, State: Running, Role: LEADER
I20260811 16:52:05.059743 5348 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } }
I20260811 16:52:05.060249 5348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30d02ebe196f44c3ace7b6a924e7eab5. Latest consensus state: current_term: 1 leader_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } } }
I20260811 16:52:05.060333 5348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [sys.catalog]: This master's current role is: LEADER
I20260811 16:52:05.061615 5235 master_runner.cc:186] Error getting master registration for 127.2.55.189:37549: OK, instance_id { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" instance_seqno: 1786467124838836 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:52:05.064268 5235 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:52:05.064688 5407 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:52:05.064994 5407 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:52:05.066597 5302 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4 [term 1 FOLLOWER]: Refusing update from remote peer 30d02ebe196f44c3ace7b6a924e7eab5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:52:05.067020 5405 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:52:05.068468 5232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:05.059076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51634 (local address 127.2.55.189:37549)
0811 16:52:05.059134 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.059136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.059367 (+ 231us) server_negotiation.cc:407] Connection header received
0811 16:52:05.059554 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.059555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.059570 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.059610 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.060821 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.061565 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.062688 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.063010 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.063060 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:05.065009 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:05.065011 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:05.065011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:05.065020 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:05.066991 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.067543 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.067544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.067545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.067616 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.067858 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.067859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.067859 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.067990 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:05.068110 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:05.068238 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 16:52:05.068329 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:52:05.069531 5370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30d02ebe196f44c3ace7b6a924e7eab5. Latest consensus state: current_term: 1 leader_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } } }
I20260811 16:52:05.069628 5370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 16:52:05.069990 5402 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:52:05.070055 5402 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:52:05.072351 5346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:05.059307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57204 (local address 127.2.55.188:35435)
0811 16:52:05.059344 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.059346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.059639 (+ 293us) server_negotiation.cc:407] Connection header received
0811 16:52:05.059809 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.059810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.059821 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.059851 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.062021 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.062789 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.063897 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.064198 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.064239 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:05.067301 (+ 3062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:05.067302 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:05.067302 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:05.067310 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:05.070939 (+ 3629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.071387 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.071389 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.071389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.071470 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.071694 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.071695 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.071695 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.071822 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:05.071917 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:05.072162 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 16:52:05.072258 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:52:05.072454 5348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } } }
I20260811 16:52:05.072562 5348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [sys.catalog]: This master's current role is: LEADER
I20260811 16:52:05.072695 5408 mvcc.cc:205] Tried to move back new op lower bound from 7317369344270356480 to 7317369344245567488. Current Snapshot: MvccSnapshot[applied={T|T < 7317369344270356480}]
I20260811 16:52:05.073051 5370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } } }
I20260811 16:52:05.073128 5370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:52:05.073956 5409 mvcc.cc:205] Tried to move back new op lower bound from 7317369344270356480 to 7317369344245567488. Current Snapshot: MvccSnapshot[applied={T|T < 7317369344270356480 or (T in {7317369344270356480})}]
I20260811 16:52:05.075083 5227 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } attempt: 3
I20260811 16:52:05.079604 5098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:05.069698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41868 (local address 127.2.55.190:42999)
0811 16:52:05.069781 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.069782 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.069791 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:52:05.069813 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.069814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.069824 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.069881 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.071154 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.071871 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.073254 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.073528 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.073580 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:05.076217 (+ 2637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:05.076219 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:05.076219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:05.076227 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:05.078116 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.078588 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.078589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.078590 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.078673 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.078904 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.078905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.078906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.079046 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:05.079148 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:05.079405 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 16:52:05.079495 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 16:52:05.080214 5407 catalog_manager.cc:1347] Generated new cluster ID: 8048edf2828a49569bfcbdcb8a28cbe1
I20260811 16:52:05.080267 5407 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:52:05 dist-test-slave-3h5h krb5kdc[4959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467124, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.189@KRBTEST.COM for kudu/127.2.55.188@KRBTEST.COM
I20260811 16:52:05.084362 5229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:05.075638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:35435 (local address 127.0.0.1:57208)
0811 16:52:05.075711 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:05.075722 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:05.075824 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:05.076087 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:05.076088 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:05.076431 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:05.076500 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:05.076503 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.077501 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.077502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:05.078333 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:05.078336 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.078890 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.078891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:05.078977 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:05.079481 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:05.079487 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:05.081038 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:05.082863 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:05.082864 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:05.082865 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:05.083105 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:05.083344 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:05.083345 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:05.083345 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:05.083420 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:05.084038 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:05.084038 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:05.084098 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 16:52:05.084162 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:52:05.084263 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 16:52:05.084411 5346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:05.075529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57208 (local address 127.2.55.188:35435)
0811 16:52:05.075572 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.075574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.075791 (+ 217us) server_negotiation.cc:407] Connection header received
0811 16:52:05.075912 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.075914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.075924 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.076036 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.076600 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.077358 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.078451 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:05.078795 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:05.078864 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:05.081139 (+ 2275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:05.081140 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:05.081140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:05.081147 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:05.082774 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.083202 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.083203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.083204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.083269 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:05.083497 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:05.083498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:05.083498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:05.083654 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:05.083728 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:05.084210 (+ 482us) server_negotiation.cc:299] Negotiation successful
0811 16:52:05.084311 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:52:05.086575 5227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d: Bootstrap starting.
I20260811 16:52:05.087370 5227 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d: Neither blocks nor log segments found. Creating new log.
I20260811 16:52:05.087706 5227 log.cc:824] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:52:05.088646 5227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d: No bootstrap required, opened a new log
I20260811 16:52:05.090879 5227 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } }
I20260811 16:52:05.091226 5227 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51fcf3d2757a4a6ba6372211f0d45f6d, State: Initialized, Role: FOLLOWER
I20260811 16:52:05.091341 5227 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } }
I20260811 16:52:05.091771 5227 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:52:05.091789 5182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d"
I20260811 16:52:05.091948 5181 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:52:05.091722 5417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } } }
I20260811 16:52:05.092293 5417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:52:05.093104 5181 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d [term 1 FOLLOWER]: Refusing update from remote peer 30d02ebe196f44c3ace7b6a924e7eab5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:52:05.094449 5182 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d02ebe196f44c3ace7b6a924e7eab5 in term 1.
I20260811 16:52:05.094851 5348 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 16:52:05.095271 5433 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:52:05.095323 5433 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:52:05.096547 5417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30d02ebe196f44c3ace7b6a924e7eab5. Latest consensus state: current_term: 1 leader_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } } }
I20260811 16:52:05.096648 5417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:52:05.096695 5417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } } }
I20260811 16:52:05.096753 5417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:52:05.097087 5407 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:52:05.097831 5407 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:52:05.105190 5348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d02ebe196f44c3ace7b6a924e7eab5" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 42999 } } peers { permanent_uuid: "51fcf3d2757a4a6ba6372211f0d45f6d" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37549 } } peers { permanent_uuid: "151cd398ad4d425984e1fc5e6534eda4" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 35435 } } }
I20260811 16:52:05.105319 5348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5 [sys.catalog]: This master's current role is: LEADER
I20260811 16:52:05.105543 5436 mvcc.cc:205] Tried to move back new op lower bound from 7317369344368934912 to 7317369344245567488. Current Snapshot: MvccSnapshot[applied={T|T < 7317369344270356480}]
I20260811 16:52:05.106969 5407 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 30d02ebe196f44c3ace7b6a924e7eab5: Generated new TSK 0
I20260811 16:52:05.107169 5407 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 16:52:05.138545 5232 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:05.136787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51642 (local address 127.2.55.189:37549)
0811 16:52:05.136862 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.136864 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.137829 (+ 965us) server_negotiation.cc:407] Connection header received
0811 16:52:05.137940 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.137942 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.137954 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.137986 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.138457 (+ 471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51642: BlockingRecv error: recv got EOF from 127.0.0.1:51642 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 16:52:05.139726 5346 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:05.137207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57222 (local address 127.2.55.188:35435)
0811 16:52:05.137250 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.137252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.138936 (+ 1684us) server_negotiation.cc:407] Connection header received
0811 16:52:05.139224 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.139226 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.139238 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.139267 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.139664 (+ 397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57222: BlockingRecv error: recv got EOF from 127.0.0.1:57222 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 16:52:05.140450 5098 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:05.137555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41876 (local address 127.2.55.190:42999)
0811 16:52:05.137597 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.137599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.139075 (+ 1476us) server_negotiation.cc:407] Connection header received
0811 16:52:05.140028 (+ 953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.140030 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.140043 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.140075 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.140383 (+ 308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41876: BlockingRecv error: recv got EOF from 127.0.0.1:41876 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 16:52:05.143373 5232 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:05.142191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51646 (local address 127.2.55.189:37549)
0811 16:52:05.142233 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.142234 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.142820 (+ 586us) server_negotiation.cc:407] Connection header received
0811 16:52:05.142939 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.142940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.142962 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.142993 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.143320 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51646: BlockingRecv error: recv got EOF from 127.0.0.1:51646 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 16:52:05.146605 5232 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:05.145818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51658 (local address 127.2.55.189:37549)
0811 16:52:05.145853 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.145855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.146109 (+ 254us) server_negotiation.cc:407] Connection header received
0811 16:52:05.146206 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.146207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.146217 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.146246 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.146557 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51658: BlockingRecv error: recv got EOF from 127.0.0.1:51658 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 16:52:05.150589 5232 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:05.149789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51670 (local address 127.2.55.189:37549)
0811 16:52:05.149827 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.149829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.150071 (+ 242us) server_negotiation.cc:407] Connection header received
0811 16:52:05.150166 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.150167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.150178 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.150208 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.150540 (+ 332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51670: BlockingRecv error: recv got EOF from 127.0.0.1:51670 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 16:52:05.156694 5232 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:05.155850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51682 (local address 127.2.55.189:37549)
0811 16:52:05.155892 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.155894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.156148 (+ 254us) server_negotiation.cc:407] Connection header received
0811 16:52:05.156250 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.156251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.156262 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.156292 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.156627 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51682: BlockingRecv error: recv got EOF from 127.0.0.1:51682 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 16:52:05.167308 5232 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:05.166209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51698 (local address 127.2.55.189:37549)
0811 16:52:05.166258 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.166261 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.166593 (+ 332us) server_negotiation.cc:407] Connection header received
0811 16:52:05.166709 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.166710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.166722 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.166756 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.167192 (+ 436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51698: BlockingRecv error: recv got EOF from 127.0.0.1:51698 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 16:52:05.186355 5232 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:05.185291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51712 (local address 127.2.55.189:37549)
0811 16:52:05.185341 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.185344 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.185709 (+ 365us) server_negotiation.cc:407] Connection header received
0811 16:52:05.185814 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.185815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.185829 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.185859 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.186293 (+ 434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51712: BlockingRecv error: recv got EOF from 127.0.0.1:51712 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 16:52:05.221555 5232 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:05.220285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51726 (local address 127.2.55.189:37549)
0811 16:52:05.220341 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.220344 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.220862 (+ 518us) server_negotiation.cc:407] Connection header received
0811 16:52:05.220988 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.220989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.221003 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.221036 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.221476 (+ 440us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51726: BlockingRecv error: recv got EOF from 127.0.0.1:51726 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 16:52:05.288142 5232 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:05.287107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51736 (local address 127.2.55.189:37549)
0811 16:52:05.287191 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.287194 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.287400 (+ 206us) server_negotiation.cc:407] Connection header received
0811 16:52:05.287434 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.287435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.287447 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.287494 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.287986 (+ 492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51736: BlockingRecv error: recv got EOF from 127.0.0.1:51736 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 16:52:05.418511 5232 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:05.417496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51752 (local address 127.2.55.189:37549)
0811 16:52:05.417620 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.417623 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.417737 (+ 114us) server_negotiation.cc:407] Connection header received
0811 16:52:05.417854 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.417855 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.417869 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.417971 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.418431 (+ 460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51752: BlockingRecv error: recv got EOF from 127.0.0.1:51752 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260811 16:52:05.676600 5232 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:05.675957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51756 (local address 127.2.55.189:37549)
0811 16:52:05.676051 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:05.676053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:05.676063 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:52:05.676097 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:05.676099 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:05.676111 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:05.676161 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:05.676523 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51756: BlockingRecv error: recv got EOF from 127.0.0.1:51756 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 16:52:06.070585 5402 catalog_manager.cc:1259] Loaded cluster ID: 8048edf2828a49569bfcbdcb8a28cbe1
I20260811 16:52:06.070715 5402 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4: loading cluster ID for follower catalog manager: success
I20260811 16:52:06.071636 5402 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4: acquiring CA information for follower catalog manager: success
I20260811 16:52:06.071983 5402 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 151cd398ad4d425984e1fc5e6534eda4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:52:06.095830 5433 catalog_manager.cc:1259] Loaded cluster ID: 8048edf2828a49569bfcbdcb8a28cbe1
I20260811 16:52:06.096086 5433 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d: loading cluster ID for follower catalog manager: success
I20260811 16:52:06.097118 5433 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d: acquiring CA information for follower catalog manager: success
I20260811 16:52:06.097530 5433 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 51fcf3d2757a4a6ba6372211f0d45f6d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:52:06.193260 5550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:06.190022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51762 (local address 127.2.55.189:37549)
0811 16:52:06.190190 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:06.190193 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:06.190297 (+ 104us) server_negotiation.cc:407] Connection header received
0811 16:52:06.190428 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:06.190429 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:06.190519 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:06.190629 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:52:06.190804 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:06.191354 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:06.192244 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:06.192457 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:06.192561 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:06.192792 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:52:06.192933 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:52:06.193026 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:06.193072 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 16:52:06.193093 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":63,"threads_started":1}
I20260811 16:52:06.198324 5562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:06.195470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57232 (local address 127.2.55.188:35435)
0811 16:52:06.195609 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:06.195611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:06.195620 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:52:06.195662 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:06.195663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:06.195707 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:06.195796 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:52:06.195932 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:06.196422 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:06.197301 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:06.197519 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:06.197607 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:06.197842 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:52:06.197973 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:52:06.198062 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:06.198147 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 16:52:06.198181 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":66,"threads_started":1}
I20260811 16:52:06.203692 5562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:06.200714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57244 (local address 127.2.55.188:35435)
0811 16:52:06.200768 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:06.200770 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:06.200777 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:52:06.200806 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:06.200807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:06.200816 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:06.200942 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:52:06.201109 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:06.201771 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:06.202862 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:06.203160 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:06.203247 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:06.203411 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:52:06.203446 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:52:06.203497 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:06.203592 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 16:52:06.203620 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 16:52:06.203769 5550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:06.200429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51772 (local address 127.2.55.189:37549)
0811 16:52:06.200590 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:06.200593 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:06.200752 (+ 159us) server_negotiation.cc:407] Connection header received
0811 16:52:06.200915 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:06.200916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:06.200930 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:06.200962 (+ 32us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:52:06.201247 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:06.201963 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:06.202990 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:06.203195 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:06.203284 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:06.203482 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:52:06.203516 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:52:06.203571 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:06.203648 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 16:52:06.203670 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260811 16:52:06.204406 5571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:06.200435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41890 (local address 127.2.55.190:42999)
0811 16:52:06.200608 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:06.200610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:06.200731 (+ 121us) server_negotiation.cc:407] Connection header received
0811 16:52:06.201111 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:06.201112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:06.201166 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:06.201250 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:52:06.201468 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:06.202195 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:06.203038 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:06.203353 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:06.203416 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:06.203701 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:52:06.204101 (+ 400us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:52:06.204137 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:06.204291 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 16:52:06.204322 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":89,"threads_started":1}
I20260811 16:52:06.206259 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 4982
I20260811 16:52:06.223814 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 5104
I20260811 16:52:06.235001 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 5235
2026-08-11T16:52:06Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3161 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:52:06 dist-test-slave-3h5h krb5kdc[5575](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:52:06 dist-test-slave-3h5h krb5kdc[5575](info): set up 2 sockets
Aug 11 16:52:06 dist-test-slave-3h5h krb5kdc[5575](info): commencing operation
krb5kdc: starting...
W20260811 16:52:07.516497 2270 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/test-user.keytab.
Aug 11 16:52:07 dist-test-slave-3h5h krb5kdc[5575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467127, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:52:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:52:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.55.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
Entry for principal kudu/127.2.55.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab.
I20260811 16:52:07.652208 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:40911
--webserver_interface=127.2.55.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:46745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:40911,127.2.55.189:37317,127.2.55.188:39147
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:52:07.736425 5593 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:52:07.736652 5593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:52:07.736670 5593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:52:07.736689 5593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:52:07.737999 5593 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:52:07.738046 5593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:52:07.738061 5593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:52:07.738075 5593 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:52:07.738142 5593 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:52:07.739722 5593 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:46745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:40911,127.2.55.189:37317,127.2.55.188:39147
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.190.keytab
--principal=kudu/127.2.55.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.190:40911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.55.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5593
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:52:07.739987 5593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:52:07.740249 5593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:52:07.745235 5601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:52:07.745256 5605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:52:07.745258 5599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:52:07.745628 5593 server_base.cc:1034] running on GCE node
I20260811 16:52:07.745891 5593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:52:07.746213 5593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:52:07.747367 5593 hybrid_clock.cc:648] HybridClock initialized: now 1786467127747356 us; error 34 us; skew 500 ppm
Aug 11 16:52:07 dist-test-slave-3h5h krb5kdc[5575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467127, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:52:07.750025 5593 init.cc:377] Logged in from keytab as kudu/127.2.55.190@KRBTEST.COM (short username kudu)
I20260811 16:52:07.750530 5593 webserver.cc:460] Webserver started at http://127.2.55.190:34827/ using document root <none> and password file <none>
I20260811 16:52:07.750793 5593 fs_manager.cc:359] Metadata directory not provided
I20260811 16:52:07.750867 5593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:52:07.751019 5593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:52:07.752103 5593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/data/instance:
uuid: "9eea66930b48492f97571699fec41e9c"
format_stamp: "Formatted at 2026-08-11 16:52:07 on dist-test-slave-3h5h"
server_key: "4124869642f0c2e949ac31063de942d4"
server_key_iv: "64249d2f88da5c9bb2d430a853f35529"
server_key_version: "encryptionkey@0"
I20260811 16:52:07.752486 5593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/wal/instance:
uuid: "9eea66930b48492f97571699fec41e9c"
format_stamp: "Formatted at 2026-08-11 16:52:07 on dist-test-slave-3h5h"
server_key: "4124869642f0c2e949ac31063de942d4"
server_key_iv: "64249d2f88da5c9bb2d430a853f35529"
server_key_version: "encryptionkey@0"
I20260811 16:52:07.753976 5593 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:52:07.754874 5614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:52:07.755053 5593 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:52:07.755180 5593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/wal
uuid: "9eea66930b48492f97571699fec41e9c"
format_stamp: "Formatted at 2026-08-11 16:52:07 on dist-test-slave-3h5h"
server_key: "4124869642f0c2e949ac31063de942d4"
server_key_iv: "64249d2f88da5c9bb2d430a853f35529"
server_key_version: "encryptionkey@0"
I20260811 16:52:07.755262 5593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:52:07.789000 5593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:52:07.791553 5593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:52:07.791743 5593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:52:07.796525 5593 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.190:40911
I20260811 16:52:07.796589 5695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.190:40911 every 8 connection(s)
I20260811 16:52:07.797005 5593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/data/info.pb
I20260811 16:52:07.798244 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 5593
I20260811 16:52:07.798295 5696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:52:07.798385 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-0/wal/instance
I20260811 16:52:07.798624 2270 external_mini_cluster.cc:1428] Setting key 6b0eacbc68dae8c363861b2c17c368fe
I20260811 16:52:07.801124 5696 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:52:07 dist-test-slave-3h5h krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467127, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.55.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.189@KRBTEST.COM" created.
I20260811 16:52:07.812733 5699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:07.801972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:40911 (local address 127.0.0.1:36494)
0811 16:52:07.802165 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:07.802214 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:07.802691 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:07.803018 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:07.803020 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:07.803289 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:07.803446 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:07.803451 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:07.805276 (+ 1825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:07.805277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:07.805957 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:07.805959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:07.806786 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:07.806787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:07.806843 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:07.807441 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:07.807449 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:07.808934 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:07.810763 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:07.810770 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:07.810772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:07.810986 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:07.811378 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:07.811379 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:07.811379 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:07.811473 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:07.811834 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:07.811840 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:07.811903 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 16:52:07.812013 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 16:52:07.812511 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":114,"thread_start_us":87,"threads_started":1}
I20260811 16:52:07.812741 5700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:07.802179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36494 (local address 127.2.55.190:40911)
0811 16:52:07.802343 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:07.802348 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:07.802394 (+ 46us) server_negotiation.cc:407] Connection header received
0811 16:52:07.802863 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:07.802866 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:07.802892 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:07.803014 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:07.803578 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:07.805165 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:07.806058 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:07.806667 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:07.806799 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:07.809028 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:07.809039 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:07.809039 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:07.809048 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:07.810674 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:07.811182 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:07.811186 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:07.811186 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:07.811277 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:07.811539 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:07.811540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:07.811540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:07.811762 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:07.811829 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:07.812077 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 16:52:07.812407 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":148,"server-negotiator.queue_time_us":120,"thread_start_us":64,"threads_started":1}
I20260811 16:52:07.815209 5696 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:52:07.815619 5699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:07.815496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37317 (local address 127.0.0.1:50828)
0811 16:52:07.815549 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:07.815595 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 16:52:07.815801 5615 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37317: connect: Connection refused (error 111)
I20260811 16:52:07.816249 5699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:07.816154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37317 (local address 127.0.0.1:50840)
0811 16:52:07.816204 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:07.816230 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 16:52:07.816385 5696 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.189:37317: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37317: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.189.keytab.
Entry for principal kudu/127.2.55.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.189.keytab.
I20260811 16:52:07.833016 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.189:37317
--webserver_interface=127.2.55.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.189.keytab
--principal=kudu/127.2.55.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:46745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:40911,127.2.55.189:37317,127.2.55.188:39147
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:52:07.865633 5696 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } attempt: 1
I20260811 16:52:07.866257 5699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:07.866103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37317 (local address 127.0.0.1:50844)
0811 16:52:07.866179 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:07.866226 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 16:52:07.866673 5699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:07.866578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37317 (local address 127.0.0.1:50846)
0811 16:52:07.866620 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:07.866657 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 16:52:07.866786 5696 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.189:37317: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37317: connect: Connection refused (error 111)
W20260811 16:52:07.921399 5704 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:52:07.921631 5704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:52:07.921649 5704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:52:07.921674 5704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:52:07.922899 5704 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:52:07.922945 5704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:52:07.922958 5704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:52:07.922971 5704 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:52:07.922983 5704 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:52:07.924585 5704 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:46745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:40911,127.2.55.189:37317,127.2.55.188:39147
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.189.keytab
--principal=kudu/127.2.55.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.189:37317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.55.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:52:07.924883 5704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:52:07.925143 5704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:52:07.930977 5713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:52:07.930977 5714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:52:07.931013 5716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:52:07.931360 5704 server_base.cc:1034] running on GCE node
I20260811 16:52:07.931696 5704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:52:07.931958 5704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:52:07.933100 5704 hybrid_clock.cc:648] HybridClock initialized: now 1786467127933083 us; error 45 us; skew 500 ppm
I20260811 16:52:07.934962 5696 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } attempt: 2
I20260811 16:52:07.935536 5699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:07.935384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37317 (local address 127.0.0.1:50856)
0811 16:52:07.935460 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:07.935504 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
Aug 11 16:52:07 dist-test-slave-3h5h krb5kdc[5575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467127, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:52:07.935921 5699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:07.935827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37317 (local address 127.0.0.1:50858)
0811 16:52:07.935869 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:07.935892 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 16:52:07.936026 5696 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.189:37317: Network error: Client connection negotiation failed: client connection to 127.2.55.189:37317: connect: Connection refused (error 111)
I20260811 16:52:07.936318 5704 init.cc:377] Logged in from keytab as kudu/127.2.55.189@KRBTEST.COM (short username kudu)
I20260811 16:52:07.936981 5704 webserver.cc:460] Webserver started at http://127.2.55.189:40551/ using document root <none> and password file <none>
I20260811 16:52:07.937284 5704 fs_manager.cc:359] Metadata directory not provided
I20260811 16:52:07.937337 5704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:52:07.937536 5704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:52:07.938761 5704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/data/instance:
uuid: "72056d3a34494d72851c25aed6c65dd2"
format_stamp: "Formatted at 2026-08-11 16:52:07 on dist-test-slave-3h5h"
server_key: "317c1a9c1023d0e77ad108f3268c342a"
server_key_iv: "757e0e6a23b0074fc2fee499ca2af733"
server_key_version: "encryptionkey@0"
I20260811 16:52:07.939181 5704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/wal/instance:
uuid: "72056d3a34494d72851c25aed6c65dd2"
format_stamp: "Formatted at 2026-08-11 16:52:07 on dist-test-slave-3h5h"
server_key: "317c1a9c1023d0e77ad108f3268c342a"
server_key_iv: "757e0e6a23b0074fc2fee499ca2af733"
server_key_version: "encryptionkey@0"
I20260811 16:52:07.940668 5704 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:52:07.941731 5725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:52:07.941923 5704 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:52:07.942001 5704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/wal
uuid: "72056d3a34494d72851c25aed6c65dd2"
format_stamp: "Formatted at 2026-08-11 16:52:07 on dist-test-slave-3h5h"
server_key: "317c1a9c1023d0e77ad108f3268c342a"
server_key_iv: "757e0e6a23b0074fc2fee499ca2af733"
server_key_version: "encryptionkey@0"
I20260811 16:52:07.942087 5704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:52:07.956158 5704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:52:07.958447 5704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:52:07.958590 5704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:52:07.963006 5704 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.189:37317
I20260811 16:52:07.963065 5796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.189:37317 every 8 connection(s)
I20260811 16:52:07.963449 5704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/data/info.pb
I20260811 16:52:07.964658 5800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:52:07.966446 5800 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:52:07.969872 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 5704
I20260811 16:52:07.969985 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-1/wal/instance
I20260811 16:52:07.970196 2270 external_mini_cluster.cc:1428] Setting key 1b5630b63a09facd50fb22d90ca61e00
Aug 11 16:52:07 dist-test-slave-3h5h krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467127, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.189@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:52:07.977124 5700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:07.967270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36504 (local address 127.2.55.190:40911)
0811 16:52:07.967348 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:07.967350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:07.967590 (+ 240us) server_negotiation.cc:407] Connection header received
0811 16:52:07.968078 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:07.968079 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:07.968090 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:07.968151 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:07.968807 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:07.969372 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:07.970560 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:07.970901 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:07.970982 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:07.973735 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:07.973738 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:07.973738 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:07.973748 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:07.975475 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:07.975972 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:07.975974 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:07.975974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:07.976030 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:07.976347 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:07.976347 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:07.976348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:07.976461 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:07.976515 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:07.976940 (+ 425us) server_negotiation.cc:299] Negotiation successful
0811 16:52:07.977013 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:52:07.977615 5804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:07.967256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:40911 (local address 127.0.0.1:36504)
0811 16:52:07.967441 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:07.967497 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:07.967991 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:07.968210 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:07.968215 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:07.968504 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:07.968714 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:07.968720 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:07.969488 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:07.969489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:07.970471 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:07.970474 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:07.971007 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:07.971008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:07.971131 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:07.971732 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:07.971742 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:07.973617 (+ 1875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:07.975566 (+ 1949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:07.975573 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:07.975575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:07.975892 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:07.976107 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:07.976108 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:07.976109 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:07.976270 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:07.976537 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:07.976546 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:07.976750 (+ 204us) client_negotiation.cc:769] Sending connection context
0811 16:52:07.976923 (+ 173us) client_negotiation.cc:240] Negotiation successful
0811 16:52:07.977131 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":103,"threads_started":1}
I20260811 16:52:07.978335 5800 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.2.55.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.55.188@KRBTEST.COM" created.
Aug 11 16:52:07 dist-test-slave-3h5h krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467127, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.189@KRBTEST.COM for kudu/127.2.55.189@KRBTEST.COM
I20260811 16:52:07.987903 5808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:07.978670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50864 (local address 127.2.55.189:37317)
0811 16:52:07.978841 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:07.978845 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:07.978864 (+ 19us) server_negotiation.cc:407] Connection header received
0811 16:52:07.978891 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:07.978892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:07.978904 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:07.978967 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:07.979302 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:07.980013 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:07.980867 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:07.981230 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:07.981292 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:07.984339 (+ 3047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:07.984347 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:07.984347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:07.984354 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:07.986342 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:07.986805 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:07.986808 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:07.986809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:07.986892 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:07.987226 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:07.987227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:07.987227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:07.987372 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:07.987437 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:07.987640 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 16:52:07.987790 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":79,"server-negotiator.queue_time_us":142,"thread_start_us":113,"threads_started":1}
I20260811 16:52:07.987982 5804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:07.978631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37317 (local address 127.0.0.1:50864)
0811 16:52:07.978698 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:07.978712 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:07.978760 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:07.978996 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:07.978998 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:07.979154 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:07.979218 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:07.979220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:07.980116 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:07.980117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:07.980752 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:07.980754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:07.981307 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:07.981308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:07.981421 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:07.981869 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:07.981874 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:07.984236 (+ 2362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:07.986458 (+ 2222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:07.986459 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:07.986460 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:07.986657 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:07.986969 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:07.986970 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:07.986970 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:07.987148 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:07.987449 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:07.987450 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:07.987505 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 16:52:07.987591 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 16:52:07.987739 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 16:52:07.988806 5800 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:52:07.989270 5804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:07.989109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:39147 (local address 127.0.0.1:55352)
0811 16:52:07.989169 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:07.989237 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:39147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 16:52:07.989435 5726 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.55.188:39147: connect: Connection refused (error 111)
I20260811 16:52:07.989987 5804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:07.989858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:39147 (local address 127.0.0.1:55354)
0811 16:52:07.989915 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:07.989952 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:39147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 16:52:07.990134 5800 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.188:39147: Network error: Client connection negotiation failed: client connection to 127.2.55.188:39147: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.55.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.188.keytab.
Entry for principal kudu/127.2.55.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.188.keytab.
I20260811 16:52:08.005067 2270 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskCmcTbT/build/release/bin/kudu
/tmp/dist-test-taskCmcTbT/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.188:39147
--webserver_interface=127.2.55.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.188.keytab
--principal=kudu/127.2.55.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.55.148:46745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.55.190:40911,127.2.55.189:37317,127.2.55.188:39147
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:52:08.027206 5696 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } attempt: 3
Aug 11 16:52:08 dist-test-slave-3h5h krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467127, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for kudu/127.2.55.189@KRBTEST.COM
I20260811 16:52:08.035447 5808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.027769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50870 (local address 127.2.55.189:37317)
0811 16:52:08.027856 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.027858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.027870 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:52:08.027909 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.027910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.027930 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.028006 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.028388 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.028989 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.029826 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.030063 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.030163 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.032496 (+ 2333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:08.032498 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:08.032498 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:08.032507 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:08.034169 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.034601 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.034602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.034603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.034668 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.034888 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.034888 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.034889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.035011 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:08.035091 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:08.035259 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 16:52:08.035345 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 16:52:08.035447 5699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.027654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37317 (local address 127.0.0.1:50870)
0811 16:52:08.027730 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:08.027744 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:08.027837 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:08.028012 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:08.028014 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:08.028210 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:08.028287 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:08.028289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.029088 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.029089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:08.029711 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:08.029714 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.030162 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.030163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:08.030252 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.030781 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:08.030790 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:08.032381 (+ 1591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:08.034295 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:08.034296 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:08.034296 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:08.034512 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:08.034743 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:08.034744 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:08.034744 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:08.034812 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:08.035089 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:08.035090 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:08.035142 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 16:52:08.035233 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 16:52:08.035343 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 16:52:08.036195 5696 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:52:08.036590 5699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.036460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:39147 (local address 127.0.0.1:55360)
0811 16:52:08.036525 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:08.036563 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:39147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 16:52:08.036996 5699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.036900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:39147 (local address 127.0.0.1:55372)
0811 16:52:08.036947 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:08.036976 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:39147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 16:52:08.037135 5696 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.188:39147: Network error: Client connection negotiation failed: client connection to 127.2.55.188:39147: connect: Connection refused (error 111)
I20260811 16:52:08.039402 5800 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } attempt: 1
I20260811 16:52:08.039745 5804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.039642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:39147 (local address 127.0.0.1:55384)
0811 16:52:08.039688 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:08.039721 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:39147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 16:52:08.040067 5804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.039966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:39147 (local address 127.0.0.1:55390)
0811 16:52:08.040019 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:08.040044 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:39147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 16:52:08.040220 5800 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.188:39147: Network error: Client connection negotiation failed: client connection to 127.2.55.188:39147: connect: Connection refused (error 111)
I20260811 16:52:08.068311 5696 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } attempt: 1
I20260811 16:52:08.068892 5699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.068695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:39147 (local address 127.0.0.1:55396)
0811 16:52:08.068779 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:08.068847 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:39147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 16:52:08.069301 5699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.069215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:39147 (local address 127.0.0.1:55404)
0811 16:52:08.069248 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:08.069279 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:39147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260811 16:52:08.069433 5696 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.188:39147: Network error: Client connection negotiation failed: client connection to 127.2.55.188:39147: connect: Connection refused (error 111)
W20260811 16:52:08.093415 5815 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:52:08.093636 5815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:52:08.093654 5815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:52:08.093674 5815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:52:08.094867 5815 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:52:08.094909 5815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:52:08.094923 5815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:52:08.094936 5815 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:52:08.094949 5815 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:52:08.096494 5815 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.55.148:46745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.2.55.190:40911,127.2.55.189:37317,127.2.55.188:39147
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/krb5kdc/kudu_127.2.55.188.keytab
--principal=kudu/127.2.55.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.55.188:39147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.55.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:52:08.096769 5815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:52:08.097083 5815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:52:08.102468 5823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:52:08.102488 5824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:52:08.102569 5826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:52:08.102805 5815 server_base.cc:1034] running on GCE node
I20260811 16:52:08.103297 5815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:52:08.103667 5815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:52:08.104882 5815 hybrid_clock.cc:648] HybridClock initialized: now 1786467128104792 us; error 68 us; skew 500 ppm
Aug 11 16:52:08 dist-test-slave-3h5h krb5kdc[5575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467128, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:52:08.107721 5815 init.cc:377] Logged in from keytab as kudu/127.2.55.188@KRBTEST.COM (short username kudu)
I20260811 16:52:08.108248 5815 webserver.cc:460] Webserver started at http://127.2.55.188:34041/ using document root <none> and password file <none>
I20260811 16:52:08.108392 5800 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } attempt: 2
I20260811 16:52:08.108539 5815 fs_manager.cc:359] Metadata directory not provided
I20260811 16:52:08.108618 5815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:52:08.108785 5815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:52:08.108881 5804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.108687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:39147 (local address 127.0.0.1:55412)
0811 16:52:08.108759 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:08.108797 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:39147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 16:52:08.109277 5804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.109185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:39147 (local address 127.0.0.1:55420)
0811 16:52:08.109234 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:08.109259 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.55.188:39147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 16:52:08.109405 5800 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.55.188:39147: Network error: Client connection negotiation failed: client connection to 127.2.55.188:39147: connect: Connection refused (error 111)
I20260811 16:52:08.110222 5815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/data/instance:
uuid: "7f43a105cc4b4fc58de72e02825f7ada"
format_stamp: "Formatted at 2026-08-11 16:52:08 on dist-test-slave-3h5h"
server_key: "088a1854b21744f3a99dbf14f5a05afc"
server_key_iv: "be2c478329cd4d7ac4cae5a23e7f373d"
server_key_version: "encryptionkey@0"
I20260811 16:52:08.110576 5815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/wal/instance:
uuid: "7f43a105cc4b4fc58de72e02825f7ada"
format_stamp: "Formatted at 2026-08-11 16:52:08 on dist-test-slave-3h5h"
server_key: "088a1854b21744f3a99dbf14f5a05afc"
server_key_iv: "be2c478329cd4d7ac4cae5a23e7f373d"
server_key_version: "encryptionkey@0"
I20260811 16:52:08.112108 5815 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:52:08.113057 5835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:52:08.113309 5815 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:52:08.113415 5815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/data,/tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/wal
uuid: "7f43a105cc4b4fc58de72e02825f7ada"
format_stamp: "Formatted at 2026-08-11 16:52:08 on dist-test-slave-3h5h"
server_key: "088a1854b21744f3a99dbf14f5a05afc"
server_key_iv: "be2c478329cd4d7ac4cae5a23e7f373d"
server_key_version: "encryptionkey@0"
I20260811 16:52:08.113500 5815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:52:08.131453 5815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:52:08.137326 5815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:52:08.137485 5815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:52:08.141955 5815 rpc_server.cc:307] RPC server started. Bound to: 127.2.55.188:39147
I20260811 16:52:08.141978 5917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.55.188:39147 every 8 connection(s)
I20260811 16:52:08.142374 5815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/data/info.pb
I20260811 16:52:08.143500 5918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:52:08.144619 5696 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } attempt: 2
I20260811 16:52:08.145936 5918 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:52:08 dist-test-slave-3h5h krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467127, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.190@KRBTEST.COM for kudu/127.2.55.188@KRBTEST.COM
I20260811 16:52:08.151291 2270 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskCmcTbT/build/release/bin/kudu as pid 5815
I20260811 16:52:08.151466 2270 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskCmcTbT/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466835675343-2270-0/minicluster-data/master-2/wal/instance
I20260811 16:52:08.151762 2270 external_mini_cluster.cc:1428] Setting key 22a0327e983d6ed983b7953edf8a70d6
Aug 11 16:52:08 dist-test-slave-3h5h krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467128, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.188@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
I20260811 16:52:08.155543 5699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.144999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:39147 (local address 127.0.0.1:55426)
0811 16:52:08.145082 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:08.145102 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:08.145177 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:08.146097 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:08.146098 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:08.146318 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:08.146385 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:08.146388 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.147761 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.147762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:08.148277 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:08.148278 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.149187 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.149188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:08.149265 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.149744 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:08.149750 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:08.151345 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:08.153841 (+ 2496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:08.153842 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:08.153842 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:08.154064 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:08.154611 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:08.154612 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:08.154612 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:08.154695 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:08.155236 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:08.155237 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:08.155278 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 16:52:08.155383 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 16:52:08.155468 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 16:52:08.155977 5920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.145168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55426 (local address 127.2.55.188:39147)
0811 16:52:08.145342 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.145357 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.145384 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:52:08.145892 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.145899 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.145949 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.146071 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.146492 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.147668 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.148372 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.149017 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.149146 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.151491 (+ 2345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:08.151499 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:08.151499 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:08.151525 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:08.153728 (+ 2203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.154182 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.154186 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.154186 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.154294 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.154787 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.154788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.154789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.155119 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:08.155228 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:08.155479 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 16:52:08.155615 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":90,"threads_started":1}
I20260811 16:52:08.157368 5922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.146727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.190:40911 (local address 127.0.0.1:36518)
0811 16:52:08.147018 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:08.147058 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:08.147133 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:08.147264 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:08.147267 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:08.147561 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:08.147662 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:08.147667 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.149227 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.149228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:08.150265 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:08.150269 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.150802 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.150803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:08.150864 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.151428 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:08.151443 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:08.153348 (+ 1905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:08.155757 (+ 2409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:08.155762 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:08.155764 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:08.156008 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:08.156520 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:08.156521 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:08.156521 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:08.156616 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:08.156953 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:08.156961 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:08.157014 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 16:52:08.157119 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 16:52:08.157256 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":4,"thread_start_us":81,"threads_started":1}
I20260811 16:52:08.157743 5700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.146807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36518 (local address 127.2.55.190:40911)
0811 16:52:08.146862 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.146864 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.147146 (+ 282us) server_negotiation.cc:407] Connection header received
0811 16:52:08.147177 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.147178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.147189 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.147250 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.148392 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.149071 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.150387 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.150681 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.150763 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.153454 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:08.153455 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:08.153456 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:08.153465 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:08.155183 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.156361 (+ 1178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.156362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.156363 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.156421 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.156704 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.156705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.156705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.156892 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:08.156960 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:08.157542 (+ 582us) server_negotiation.cc:299] Negotiation successful
0811 16:52:08.157639 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:52:08.158258 5918 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:52:08.158309 5696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c: Bootstrap starting.
I20260811 16:52:08.159192 5696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c: Neither blocks nor log segments found. Creating new log.
I20260811 16:52:08.159583 5696 log.cc:824] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c: Log is configured to *not* fsync() on all Append() calls
Aug 11 16:52:08 dist-test-slave-3h5h krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467127, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.188@KRBTEST.COM
I20260811 16:52:08.160799 5696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c: No bootstrap required, opened a new log
Aug 11 16:52:08 dist-test-slave-3h5h krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467128, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.188@KRBTEST.COM for kudu/127.2.55.189@KRBTEST.COM
I20260811 16:52:08.163385 5696 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } }
I20260811 16:52:08.163568 5696 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eea66930b48492f97571699fec41e9c, State: Initialized, Role: FOLLOWER
I20260811 16:52:08.163661 5696 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } }
I20260811 16:52:08.164068 5696 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:52:08.164121 5931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } } }
I20260811 16:52:08.164215 5931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:52:08.164610 5926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.152351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55436 (local address 127.2.55.188:39147)
0811 16:52:08.152964 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.152966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.152975 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:52:08.152999 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.152999 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.153011 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.153091 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.153874 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.154530 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.156749 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.157087 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.157164 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.160772 (+ 3608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:08.160773 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:08.160774 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:08.160781 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:08.162744 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.163168 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.163170 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.163170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.163249 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.163475 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.163476 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.163476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.163627 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:08.163783 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:08.164343 (+ 560us) server_negotiation.cc:299] Negotiation successful
0811 16:52:08.164430 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":91,"threads_started":1}
W20260811 16:52:08.166239 5943 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:52:08.166294 5943 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:52:08.166518 5922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.158545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.189:37317 (local address 127.0.0.1:50876)
0811 16:52:08.158591 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:08.158601 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:08.158647 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:08.158792 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:08.158792 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:08.158970 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:08.159024 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:08.159026 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.159791 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.159792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:08.160530 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:08.160533 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.161025 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.161026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:08.161719 (+ 693us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.162174 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:08.162179 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:08.163502 (+ 1323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:08.165313 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:08.165314 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:08.165315 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:08.165528 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:08.165849 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:08.165850 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:08.165851 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:08.165916 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:08.166228 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:08.166229 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:08.166273 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 16:52:08.166339 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 16:52:08.166434 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 16:52:08.166878 5808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.158637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50876 (local address 127.2.55.189:37317)
0811 16:52:08.158685 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.158687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.158694 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:52:08.158719 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.158719 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.158728 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.158788 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.159179 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.159696 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.160636 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.160908 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.160972 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.163588 (+ 2616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:08.163590 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:08.163590 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:08.163598 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:08.165213 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.165613 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.165614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.165614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.165711 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.165994 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.165995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.165996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.166132 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:08.166199 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:08.166709 (+ 510us) server_negotiation.cc:299] Negotiation successful
0811 16:52:08.166790 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:52:08.167548 5918 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:52:08.167157 5593 master_runner.cc:186] Error getting master registration for 127.2.55.189:37317: OK, instance_id { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" instance_seqno: 1786467127961748 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:52:08.170617 5593 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 11 16:52:08 dist-test-slave-3h5h krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467127, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.190@KRBTEST.COM
Aug 11 16:52:08 dist-test-slave-3h5h krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467128, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.188@KRBTEST.COM for kudu/127.2.55.188@KRBTEST.COM
I20260811 16:52:08.175540 5700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.165324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36524 (local address 127.2.55.190:40911)
0811 16:52:08.165375 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.165378 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.165446 (+ 68us) server_negotiation.cc:407] Connection header received
0811 16:52:08.165568 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.165569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.165581 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.165618 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.166402 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.167126 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.168261 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.168556 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.168642 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.171511 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:08.171513 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:08.171513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:08.171522 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:08.173490 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.174025 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.174027 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.174027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.174099 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.174354 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.174357 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.174357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.174503 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:08.174674 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:08.175332 (+ 658us) server_negotiation.cc:299] Negotiation successful
0811 16:52:08.175430 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:52:08.177276 5922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.167791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:39147 (local address 127.0.0.1:55446)
0811 16:52:08.167875 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:08.167886 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:08.167924 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:08.169393 (+ 1469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:08.169394 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:08.169546 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:08.169579 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:08.169581 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.170456 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.170457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:08.171218 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:08.171220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.171858 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.171858 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:08.171907 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.172327 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:08.172332 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:08.173939 (+ 1607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:08.176011 (+ 2072us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:08.176012 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:08.176013 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:08.176235 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:08.176425 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:08.176426 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:08.176426 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:08.176505 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:08.176823 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:08.176823 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:08.176937 (+ 114us) client_negotiation.cc:769] Sending connection context
0811 16:52:08.177018 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 16:52:08.177129 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 16:52:08.177644 5926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.169217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55446 (local address 127.2.55.188:39147)
0811 16:52:08.169257 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.169260 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.169269 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:52:08.169289 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.169289 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.169299 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.169373 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.169682 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.170369 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.171420 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.171748 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.171814 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.174060 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:08.174061 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:08.174062 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:08.174069 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:08.175907 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.176318 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.176319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.176320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.176368 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.176591 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.176592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.176593 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.176733 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:08.176798 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:08.177476 (+ 678us) server_negotiation.cc:299] Negotiation successful
0811 16:52:08.177559 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:52:08.179384 5918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada: Bootstrap starting.
I20260811 16:52:08.180562 5918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada: Neither blocks nor log segments found. Creating new log.
I20260811 16:52:08.180989 5918 log.cc:824] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada: Log is configured to *not* fsync() on all Append() calls
I20260811 16:52:08.181968 5918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada: No bootstrap required, opened a new log
Aug 11 16:52:08 dist-test-slave-3h5h krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467127, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.55.189@KRBTEST.COM
I20260811 16:52:08.184186 5918 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } }
I20260811 16:52:08.184319 5918 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f43a105cc4b4fc58de72e02825f7ada, State: Initialized, Role: FOLLOWER
I20260811 16:52:08.184382 5918 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } }
I20260811 16:52:08.184706 5918 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:52:08.184644 5946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } } }
I20260811 16:52:08.184772 5946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:52:08.186815 5808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.176552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50886 (local address 127.2.55.189:37317)
0811 16:52:08.176596 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.176598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.176608 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:52:08.176650 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.176650 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.176660 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.176714 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.177451 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.178277 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.179286 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.179666 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.179745 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.182852 (+ 3107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:08.182854 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:08.182854 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:08.182862 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:08.184938 (+ 2076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.185416 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.185417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.185418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.185482 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.185906 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.185907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.185908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.186091 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:08.186298 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:08.186603 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 16:52:08.186710 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 16:52:08.187455 5970 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:52:08.187573 5970 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:52:08.188310 2270 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:52:08.189324 5659 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "9eea66930b48492f97571699fec41e9c"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36524
I20260811 16:52:08.189510 5659 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:52:08.189579 5659 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:52:08.190693 5659 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } }
I20260811 16:52:08.190971 5659 leader_election.cc:288] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [CANDIDATE]: Term 1 election: Requested vote from peers 72056d3a34494d72851c25aed6c65dd2 (127.2.55.189:37317), 7f43a105cc4b4fc58de72e02825f7ada (127.2.55.188:39147)
I20260811 16:52:08.189142 5815 master_runner.cc:186] Error getting master registration for 127.2.55.189:37317: OK, instance_id { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" instance_seqno: 1786467127961748 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:52:08.192055 5815 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:52:08.192178 5878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9eea66930b48492f97571699fec41e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7f43a105cc4b4fc58de72e02825f7ada"
I20260811 16:52:08.192332 5878 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:52:08.193475 5878 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eea66930b48492f97571699fec41e9c in term 1.
I20260811 16:52:08.193732 5615 leader_election.cc:302] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f43a105cc4b4fc58de72e02825f7ada, 9eea66930b48492f97571699fec41e9c; no voters:
I20260811 16:52:08.193917 5931 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:52:08.194115 5931 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [term 1 LEADER]: Becoming Leader. State: Replica: 9eea66930b48492f97571699fec41e9c, State: Running, Role: LEADER
I20260811 16:52:08.194267 5931 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } }
I20260811 16:52:08.194820 5931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9eea66930b48492f97571699fec41e9c. Latest consensus state: current_term: 1 leader_uuid: "9eea66930b48492f97571699fec41e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } } }
I20260811 16:52:08.194933 5931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [sys.catalog]: This master's current role is: LEADER
I20260811 16:52:08.195207 5983 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:52:08.195442 5983 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:52:08.200534 5800 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } attempt: 3
Aug 11 16:52:08 dist-test-slave-3h5h krb5kdc[5575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786467127, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.55.189@KRBTEST.COM for kudu/127.2.55.188@KRBTEST.COM
I20260811 16:52:08.206908 5878 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada [term 1 FOLLOWER]: Refusing update from remote peer 9eea66930b48492f97571699fec41e9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:52:08.207315 5931 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:52:08.208953 5946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9eea66930b48492f97571699fec41e9c. Latest consensus state: current_term: 1 leader_uuid: "9eea66930b48492f97571699fec41e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } } }
I20260811 16:52:08.209085 5946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:52:08.210031 5808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.193182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50888 (local address 127.2.55.189:37317)
0811 16:52:08.193233 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.193236 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.194174 (+ 938us) server_negotiation.cc:407] Connection header received
0811 16:52:08.194589 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.194590 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.194606 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.194646 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.196768 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.197630 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.199960 (+ 2330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.200277 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.200324 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.203336 (+ 3012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:08.203338 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:08.203338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:08.203346 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:08.206959 (+ 3613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.209196 (+ 2237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.209198 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.209198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.209256 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.209450 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.209451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.209452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.209607 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:08.209721 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:08.209830 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 16:52:08.209912 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:52:08.211236 5981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9eea66930b48492f97571699fec41e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } } }
I20260811 16:52:08.211346 5981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [sys.catalog]: This master's current role is: LEADER
I20260811 16:52:08.212194 5983 catalog_manager.cc:1347] Generated new cluster ID: ed813b6019924d76802f2de48c848cdc
I20260811 16:52:08.212257 5983 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:52:08.212854 5926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.193403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55448 (local address 127.2.55.188:39147)
0811 16:52:08.193448 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.193450 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.197061 (+ 3611us) server_negotiation.cc:407] Connection header received
0811 16:52:08.197363 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.197364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.197378 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.197415 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.198402 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.199228 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.200914 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.201246 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.201291 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.208426 (+ 7135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:08.208427 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:08.208428 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:08.208435 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:08.210584 (+ 2149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.211617 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.211618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.211618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.211710 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.211955 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.211956 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.211956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.212107 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:08.212200 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:08.212638 (+ 438us) server_negotiation.cc:299] Negotiation successful
0811 16:52:08.212734 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:52:08.214242 5946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9eea66930b48492f97571699fec41e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } } }
I20260811 16:52:08.214345 5946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:52:08.217029 5804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.200978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.55.188:39147 (local address 127.0.0.1:55458)
0811 16:52:08.201034 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 16:52:08.201043 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:52:08.201081 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:52:08.201445 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:52:08.201446 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:52:08.201641 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:52:08.201686 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:08.201688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.202595 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.202596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:08.203416 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:52:08.203418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.203983 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.203984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:52:08.204057 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.204627 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:52:08.204633 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:52:08.207286 (+ 2653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:52:08.211563 (+ 4277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:08.211564 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:08.211564 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:08.211786 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:08.216299 (+ 4513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:52:08.216300 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:52:08.216300 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:52:08.216369 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:52:08.216667 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:52:08.216668 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:52:08.216713 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 16:52:08.216780 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 16:52:08.216929 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 16:52:08.217429 5920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.200918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55458 (local address 127.2.55.188:39147)
0811 16:52:08.201345 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.201347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.201354 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:52:08.201373 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.201373 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.201382 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.201438 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.201765 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.202490 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.203505 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.203864 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.203927 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.207377 (+ 3450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:08.207378 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:08.207378 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:08.207385 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:08.211488 (+ 4103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.216135 (+ 4647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.216136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.216137 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.216201 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.216441 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.216442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.216442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.216570 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:08.216631 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:08.217253 (+ 622us) server_negotiation.cc:299] Negotiation successful
0811 16:52:08.217339 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410}
I20260811 16:52:08.218992 5800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2: Bootstrap starting.
I20260811 16:52:08.219132 5700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:08.193582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36536 (local address 127.2.55.190:40911)
0811 16:52:08.193634 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.193636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.197177 (+ 3541us) server_negotiation.cc:407] Connection header received
0811 16:52:08.197266 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.197267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.197281 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.197352 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.202631 (+ 5279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.203411 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.205388 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:08.205675 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:08.205743 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:08.214568 (+ 8825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:52:08.214569 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:52:08.214570 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:52:08.214578 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:52:08.216504 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.217879 (+ 1375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.217880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.217881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.217952 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:52:08.218304 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:52:08.218305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:52:08.218306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:52:08.218450 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:52:08.218556 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:08.218930 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 16:52:08.219023 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:52:08.219780 5800 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2: Neither blocks nor log segments found. Creating new log.
I20260811 16:52:08.220103 5800 log.cc:824] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2: Log is configured to *not* fsync() on all Append() calls
I20260811 16:52:08.221393 5800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2: No bootstrap required, opened a new log
I20260811 16:52:08.223518 5800 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } }
I20260811 16:52:08.223691 5800 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72056d3a34494d72851c25aed6c65dd2, State: Initialized, Role: FOLLOWER
I20260811 16:52:08.223786 5800 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } }
I20260811 16:52:08.224202 5800 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:52:08.224243 5762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9eea66930b48492f97571699fec41e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "72056d3a34494d72851c25aed6c65dd2"
I20260811 16:52:08.224289 5761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:52:08.225368 5761 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2 [term 1 FOLLOWER]: Refusing update from remote peer 9eea66930b48492f97571699fec41e9c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:52:08.226213 5762 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9eea66930b48492f97571699fec41e9c in term 1.
I20260811 16:52:08.226953 5931 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:52:08.224169 5992 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } } }
I20260811 16:52:08.227424 5992 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:52:08.228789 6002 mvcc.cc:205] Tried to move back new op lower bound from 7317369357124132864 to 7317369357084737536. Current Snapshot: MvccSnapshot[applied={T|T < 7317369357124132864}]
I20260811 16:52:08.228912 5986 mvcc.cc:205] Tried to move back new op lower bound from 7317369357124132864 to 7317369357084737536. Current Snapshot: MvccSnapshot[applied={T|T < 7317369357124132864 or (T in {7317369357124132864})}]
I20260811 16:52:08.233119 5992 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9eea66930b48492f97571699fec41e9c. Latest consensus state: current_term: 1 leader_uuid: "9eea66930b48492f97571699fec41e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } } }
I20260811 16:52:08.233227 5992 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:52:08.233268 5992 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9eea66930b48492f97571699fec41e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } } }
I20260811 16:52:08.233318 5992 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 16:52:08.234879 6016 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:52:08.235013 6016 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:52:08.238639 5983 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:52:08.239359 5983 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:52:08.246575 5981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9eea66930b48492f97571699fec41e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9eea66930b48492f97571699fec41e9c" member_type: VOTER last_known_addr { host: "127.2.55.190" port: 40911 } } peers { permanent_uuid: "72056d3a34494d72851c25aed6c65dd2" member_type: VOTER last_known_addr { host: "127.2.55.189" port: 37317 } } peers { permanent_uuid: "7f43a105cc4b4fc58de72e02825f7ada" member_type: VOTER last_known_addr { host: "127.2.55.188" port: 39147 } } }
I20260811 16:52:08.246702 5981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c [sys.catalog]: This master's current role is: LEADER
I20260811 16:52:08.251771 5983 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9eea66930b48492f97571699fec41e9c: Generated new TSK 0
I20260811 16:52:08.251958 5983 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 16:52:08.278436 5700 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:08.276365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36544 (local address 127.2.55.190:40911)
0811 16:52:08.276420 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.276423 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.277619 (+ 1196us) server_negotiation.cc:407] Connection header received
0811 16:52:08.277778 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.277779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.277792 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.277827 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.278348 (+ 521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36544: BlockingRecv error: recv got EOF from 127.0.0.1:36544 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 16:52:08.279493 5808 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:08.276932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50890 (local address 127.2.55.189:37317)
0811 16:52:08.276980 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.276982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.278902 (+ 1920us) server_negotiation.cc:407] Connection header received
0811 16:52:08.279013 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.279014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.279026 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.279060 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.279424 (+ 364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50890: BlockingRecv error: recv got EOF from 127.0.0.1:50890 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 16:52:08.280438 5920 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:08.277289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55472 (local address 127.2.55.188:39147)
0811 16:52:08.277334 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.277336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.279900 (+ 2564us) server_negotiation.cc:407] Connection header received
0811 16:52:08.280008 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.280010 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.280021 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.280052 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.280377 (+ 325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55472: BlockingRecv error: recv got EOF from 127.0.0.1:55472 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 16:52:08.283289 5808 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:08.282372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50900 (local address 127.2.55.189:37317)
0811 16:52:08.282427 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.282429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.282711 (+ 282us) server_negotiation.cc:407] Connection header received
0811 16:52:08.282833 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.282834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.282854 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.282887 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.283239 (+ 352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50900: BlockingRecv error: recv got EOF from 127.0.0.1:50900 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 16:52:08.286983 5808 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:08.286044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50912 (local address 127.2.55.189:37317)
0811 16:52:08.286082 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.286084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.286329 (+ 245us) server_negotiation.cc:407] Connection header received
0811 16:52:08.286436 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.286437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.286449 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.286481 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.286934 (+ 453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50912: BlockingRecv error: recv got EOF from 127.0.0.1:50912 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 16:52:08.291301 5808 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:08.290402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50918 (local address 127.2.55.189:37317)
0811 16:52:08.290461 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.290463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.290717 (+ 254us) server_negotiation.cc:407] Connection header received
0811 16:52:08.290824 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.290825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.290837 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.290875 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.291249 (+ 374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50918: BlockingRecv error: recv got EOF from 127.0.0.1:50918 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 16:52:08.297883 5808 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:08.296943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50934 (local address 127.2.55.189:37317)
0811 16:52:08.296985 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.296987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.297251 (+ 264us) server_negotiation.cc:407] Connection header received
0811 16:52:08.297368 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.297369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.297382 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.297415 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.297828 (+ 413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50934: BlockingRecv error: recv got EOF from 127.0.0.1:50934 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 16:52:08.308665 5808 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:08.307594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50950 (local address 127.2.55.189:37317)
0811 16:52:08.307662 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.307665 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.307995 (+ 330us) server_negotiation.cc:407] Connection header received
0811 16:52:08.308116 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.308118 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.308132 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.308169 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.308601 (+ 432us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50950: BlockingRecv error: recv got EOF from 127.0.0.1:50950 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260811 16:52:08.327590 5808 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:08.326504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50964 (local address 127.2.55.189:37317)
0811 16:52:08.326567 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.326571 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.326911 (+ 340us) server_negotiation.cc:407] Connection header received
0811 16:52:08.327035 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.327036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.327051 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.327089 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.327518 (+ 429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50964: BlockingRecv error: recv got EOF from 127.0.0.1:50964 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260811 16:52:08.362694 5808 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:08.361598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50978 (local address 127.2.55.189:37317)
0811 16:52:08.361651 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.361653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.361954 (+ 301us) server_negotiation.cc:407] Connection header received
0811 16:52:08.362093 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.362094 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.362108 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.362144 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.362613 (+ 469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50978: BlockingRecv error: recv got EOF from 127.0.0.1:50978 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 16:52:08.429124 5808 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:08.428343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50994 (local address 127.2.55.189:37317)
0811 16:52:08.428443 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.428445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.428462 (+ 17us) server_negotiation.cc:407] Connection header received
0811 16:52:08.428543 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.428544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.428556 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.428611 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.429049 (+ 438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50994: BlockingRecv error: recv got EOF from 127.0.0.1:50994 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260811 16:52:08.559469 5808 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:08.558583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51010 (local address 127.2.55.189:37317)
0811 16:52:08.558672 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.558674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.558820 (+ 146us) server_negotiation.cc:407] Connection header received
0811 16:52:08.558888 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.558890 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.558903 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.558952 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.559394 (+ 442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51010: BlockingRecv error: recv got EOF from 127.0.0.1:51010 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 16:52:08.817461 5808 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:52:08.816712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36400 (local address 127.2.55.189:37317)
0811 16:52:08.816767 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:08.816769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:08.816875 (+ 106us) server_negotiation.cc:407] Connection header received
0811 16:52:08.816930 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:08.816931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:08.816943 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:08.817038 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:52:08.817394 (+ 356us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36400: BlockingRecv error: recv got EOF from 127.0.0.1:36400 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:52:09.188110 5970 catalog_manager.cc:1259] Loaded cluster ID: ed813b6019924d76802f2de48c848cdc
I20260811 16:52:09.188199 5970 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada: loading cluster ID for follower catalog manager: success
I20260811 16:52:09.189069 5970 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada: acquiring CA information for follower catalog manager: success
I20260811 16:52:09.189429 5970 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7f43a105cc4b4fc58de72e02825f7ada: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:52:09.235560 6016 catalog_manager.cc:1259] Loaded cluster ID: ed813b6019924d76802f2de48c848cdc
I20260811 16:52:09.235689 6016 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2: loading cluster ID for follower catalog manager: success
I20260811 16:52:09.236624 6016 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2: acquiring CA information for follower catalog manager: success
I20260811 16:52:09.236997 6016 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 72056d3a34494d72851c25aed6c65dd2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:52:09.333417 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:09.330693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36404 (local address 127.2.55.189:37317)
0811 16:52:09.330837 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:09.330839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:09.330850 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:52:09.330917 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:09.330918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:09.330980 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:09.331047 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:52:09.331236 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:09.331772 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:09.332520 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:09.332773 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:09.332826 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:09.333079 (+ 253us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:52:09.333223 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:52:09.333289 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:09.333332 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 16:52:09.333351 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":75,"threads_started":1}
I20260811 16:52:09.337847 6130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:09.335358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48382 (local address 127.2.55.188:39147)
0811 16:52:09.335478 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:09.335480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:09.335491 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:52:09.335533 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:09.335534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:09.335584 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:09.335676 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:52:09.335781 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:09.336398 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:09.337204 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:09.337394 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:09.337450 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:09.337567 (+ 117us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:52:09.337678 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:52:09.337732 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:09.337770 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 16:52:09.337786 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":50,"threads_started":1}
I20260811 16:52:09.342530 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:09.339536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36416 (local address 127.2.55.189:37317)
0811 16:52:09.339586 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:09.339588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:09.339806 (+ 218us) server_negotiation.cc:407] Connection header received
0811 16:52:09.339836 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:09.339837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:09.339850 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:09.339901 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:52:09.340107 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:09.340870 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:09.341656 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:09.341949 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:09.342028 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:09.342184 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:52:09.342217 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:52:09.342422 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:09.342438 (+ 16us) server_negotiation.cc:299] Negotiation successful
0811 16:52:09.342459 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:52:09.342864 6143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:09.339599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50696 (local address 127.2.55.190:40911)
0811 16:52:09.340135 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:09.340137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:09.340144 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:52:09.340184 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:09.340185 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:09.340241 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:09.340331 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:52:09.340445 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:09.341042 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:09.341869 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:09.342201 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:09.342276 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:09.342459 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:52:09.342562 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:52:09.342641 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:09.342737 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 16:52:09.342763 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":96,"threads_started":1}
I20260811 16:52:09.343276 6130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:52:09.339837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48384 (local address 127.2.55.188:39147)
0811 16:52:09.339877 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:52:09.339879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:52:09.339886 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:52:09.339909 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:52:09.339909 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:52:09.339919 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:52:09.339971 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:52:09.340105 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:09.340858 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:09.342493 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:52:09.342781 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:52:09.342840 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:52:09.343019 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:52:09.343050 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:52:09.343098 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:52:09.343167 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 16:52:09.343188 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:52:09.344734 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 5593
I20260811 16:52:09.357864 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 5704
I20260811 16:52:09.370453 2270 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskCmcTbT/build/release/bin/kudu with pid 5815
2026-08-11T16:52:09Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3136 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6298 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (293696 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST